BUG #3975: tsearch2 index should not bomb out of 1Mb limit

The following bug has been logged online:

Bug reference:      3975
Logged by:          Edwin Groothuis
Email address:      postgresql@mavetju.org
PostgreSQL version: 8.3
Operating system:   FreeBSD 6.3
Description:        tsearch2 index should not bomb out of 1Mb limit
Details:

I have been experimenting with indexing the FreeBSD mailinglist into a
tsearch2 powered/backended database.

Sometimes I see these warning:

NOTICE:  word is too long to be indexed
DETAIL:  Words longer than 2047 characters are ignored.

That's okay, I can live with that. However, I see this one too:

ERROR:  string is too long for tsvector

Ouch. But... since very long words are already not indexed (is the length
configurable anywhere because I don't mind setting it to 50 characters), I
don't think that it should bomb out of this but print a similar warning like
"String only partly indexed".

I'm still trying to determine how big the message it failed on was...