Re: text fields and performance for ETL

Поиск
Список
Период
Сортировка
От David G. Johnston
Тема Re: text fields and performance for ETL
Дата
Msg-id CAKFQuwa_02fEtL8zJMt7MR=xvrp-De1pQtHFtg7fSHhSm1ajnA@mail.gmail.com
обсуждение исходный текст
Ответ на text fields and performance for ETL  (PG Doc comments form <noreply@postgresql.org>)
Ответы RE: text fields and performance for ETL  (Grega Jesih <Grega.Jesih@actual-it.si>)
Список pgsql-docs
On Wed, Nov 3, 2021 at 6:55 AM PG Doc comments form <noreply@postgresql.org> wrote:
But performance in ETL processes related to such data type is decreased
dramatically, because any process that takes this kind of data needs to
calculate its size on a row level and cannot take bigger chunks of data
based on max size.

All of my ETL simply reads in the entire contents of a text field.  There is no chunking.  The documentation assumes that the sizes involved here are reasonable for such behavior.  If you have a situation where you've chosen to use varchar(n) and can defend that choice more power to you.  Those special circumstances are not of particular interest here.  For the vast majority of users they use varchar(n) because they (or more likely their teachers) come from systems where it is required.  The goal in our docs is to point out that using an arbitrary length specification is not required in PostgreSQL.

David J.

В списке pgsql-docs по дате отправления:

Предыдущее
От: Bruce Momjian
Дата:
Сообщение: Re: text fields and performance for ETL
Следующее
От: Grega Jesih
Дата:
Сообщение: RE: text fields and performance for ETL