Re: Multiple COPY on the same table
От | Adrian Klaver |
---|---|
Тема | Re: Multiple COPY on the same table |
Дата | |
Msg-id | c51bbe16-8cb5-6e8b-4ba8-f00ee44b1c63@aklaver.com обсуждение исходный текст |
Ответ на | Re: Multiple COPY on the same table (Nicolas Paris <nicolas.paris@riseup.net>) |
Ответы |
Re: Multiple COPY on the same table
|
Список | pgsql-general |
On 08/20/2018 08:56 AM, Nicolas Paris wrote: >> Can I split a large file into multiple files and then run copy using >> each file. > > AFAIK, copy command locks the table[1] while there is no mention of this > in the documentation[2]. [1] Is from Postgres 7.1(17 years ago). I suspect the conditions have changed at least a little:). > >> Will the performance boost by close to 4x?? > > You might be interested in the pbBulkInsert tool[3] that allows parallel > copy with some succes accordingly to benchmarks. However, that tool does > not handle multiline csv. Because of that limitation I have been using > the standard copy command with binary format with some succes. > > > [1] https://grokbase.com/t/postgresql/pgsql-general/01597pv3qs/copy-locking > [2] https://www.postgresql.org/docs/current/static/sql-copy.html > [3] https://github.com/bytefish/PgBulkInsert > > -- Adrian Klaver adrian.klaver@aklaver.com
В списке pgsql-general по дате отправления: