Joining tables by UUID field - very slow

We are experiencing an unusual slowdown when using UUID field in JOIN when updating a table. SQL looks like this:

UPDATE dst
SET data_field = src.data_field
FROM src
WHERE dst.uuid_field = src.uuid_field;

This statement takes over 6 times longer than a similar statement against the same table except the join is done by a integer field, e.g.

UPDATE dst
SET data_field = src.data_field
FROM src
WHERE dst.integer_field = src.integer_field;

I can't get rid of UUID in the "src" table since it comes from another database that we can't change. The table has around 1 mil rows. I tried vacuuming it. Tried creating indexes on src table (it ignores them and builds hash join anyway). It takes faster to rebuild the whole table than to update it while joining by UUID. Has anyone experienced this before and what was the solution for you?

Help is greatly appreciated.