text datatype and tuple size limits.
От | Brian Hirt |
---|---|
Тема | text datatype and tuple size limits. |
Дата | |
Msg-id | 19991027142518.A13571@loopy.berkhirt.com обсуждение исходный текст |
Ответы |
Re: [HACKERS] text datatype and tuple size limits.
|
Список | pgsql-hackers |
Hello, I'm running into what appears to be some hard coded limits of postgres. I've got a table with with a text column that I need to insert large amounts of text into. I quickly found these two things out: First, the MAX_QUERY_SIZE which is BLCKSZ*2 (or 16384 bytes), prevents me from from running the query since my query is much larger than 16384 i bytes. After discovering this, I decided to create a test query just smaller than 16384 to see what would happen. The second query returns "Tuple is too big: size 12508". I didn't bother to look into this one because I'd probably spend a lot of time looking, instead I am bringing the issue here. I haven't done any development work on postgres and don't want to get involved in doing so before discussing it here and making sure that my efforts won't be in vain. Without looking at the code, I expect this problem is not *simple* to fix. I'm operating on the assumption that tuple sizes cannot be changed very easily. Even if they could, a bigger problem is probably the MAX_QUERY_SIZE. Simply increasing the MAX_QUERY_SIZE will only address a short term problem, and there is a practicle limit to the size it can be increased. Idealy, some sort of dynamic query buffer would be better but that likely challanges the way the communication between the client and server works. So, has anyone looked into this limitation? Is it something that the development team wants to be addressed? If this is a know problem, is there some sort of agreement on how it should be solved? If so, is someone working on it? If not, possible I could help. Over the last 9 months, I've been using postgres more and more. It's gotten to the point where our project is becoming quite dependent on it. I am quite happy with the software and want to stick with it. I've run into several minor things this year that I have been able to avoid, but this one may be a show stopper. Rather than ditch this fine software, I'd rather help out if the help is wanted and I am capible of giving it the time required. More details on the problem I am having:Redhat 6.0 / x86Postgres 6.5.1Inserts tried with psql and libpg via Perl DBD/DBI -Brian
В списке pgsql-hackers по дате отправления: