Re: text fields and performance for ETL
От | David G. Johnston |
---|---|
Тема | Re: text fields and performance for ETL |
Дата | |
Msg-id | CAKFQuwa_02fEtL8zJMt7MR=xvrp-De1pQtHFtg7fSHhSm1ajnA@mail.gmail.com обсуждение исходный текст |
Ответ на | text fields and performance for ETL (PG Doc comments form <noreply@postgresql.org>) |
Ответы |
RE: text fields and performance for ETL
|
Список | pgsql-docs |
On Wed, Nov 3, 2021 at 6:55 AM PG Doc comments form <noreply@postgresql.org> wrote:
But performance in ETL processes related to such data type is decreased
dramatically, because any process that takes this kind of data needs to
calculate its size on a row level and cannot take bigger chunks of data
based on max size.
All of my ETL simply reads in the entire contents of a text field. There is no chunking. The documentation assumes that the sizes involved here are reasonable for such behavior. If you have a situation where you've chosen to use varchar(n) and can defend that choice more power to you. Those special circumstances are not of particular interest here. For the vast majority of users they use varchar(n) because they (or more likely their teachers) come from systems where it is required. The goal in our docs is to point out that using an arbitrary length specification is not required in PostgreSQL.
David J.
В списке pgsql-docs по дате отправления: