Revoke missing user

I removed a user from PostgreSQL that had privileges on some tables, now
the access privileges shows just the former user number. When I try:

  revoke all on allergies from 104;

I get:

  ERROR:  parser: parse error at or near "104" at character 30

I even try creating a user named 104, same result. How can I revoke
those privileges?

--
Robert