RE: POC: postgres_fdw insert batching

Поиск
Список
Период
Сортировка
Искать
От
tsunakawa.takay@fujitsu.com
Тема
RE: POC: postgres_fdw insert batching
Дата
Msg-id
TYAPR01MB29908B1A9704D1D85ECF09BEFEF80@TYAPR01MB2990.jpnprd01.prod.outlook.com
Ответ на
Список
Дерево обсуждения
POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: POC: postgres_fdw insert batching "Andrey V. Lepikhov" <a.lepikhov@postgrespro.ru>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@2ndquadrant.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@2ndquadrant.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching Tim.Colles@ed.ac.uk
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching David Fetter <david@fetter.org>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tom Lane <tgl@sss.pgh.pa.us>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Ian Lawrence Barwick <barwick@gmail.com>
Re: POC: postgres_fdw insert batching Ian Lawrence Barwick <barwick@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Ian Lawrence Barwick <barwick@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tom Lane <tgl@sss.pgh.pa.us>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tom Lane <tgl@sss.pgh.pa.us>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
Re: POC: postgres_fdw insert batching Andres Freund <andres@anarazel.de>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Ashutosh Bapat <ashutosh.bapat.oss@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: POC: postgres_fdw insert batching Ashutosh Bapat <ashutosh.bapat@2ndquadrant.com>
Re: POC: postgres_fdw insert batching Etsuro Fujita <etsuro.fujita@gmail.com>
Re: POC: postgres_fdw insert batching Ashutosh Bapat <ashutosh.bapat@2ndquadrant.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Etsuro Fujita <etsuro.fujita@gmail.com>
From: Tomas Vondra 
> Not sure how is this related to app developers? I think the idea was
> that the libpq features might be useful between the two PostgreSQL
> instances. I.e. the postgres_fdw would use the libpq batching to send
> chunks of data to the other side.

> Well, my point was that we could keep the API, but maybe it should be
> implemented using the proposed libpq batching. They could still use the
> postgres_fdw example how to use the API, but the internals would need to
> be different, of course.

Yes, I understand them.  I just wondered if app developers use the statement batching API for libpq or JDBC in what kind of apps.  That is, I talked about the batching API itself, not related to FDW.  (So, I mentioned I think I should ask such a question in the libpq batching thread.)

I expect postgresExecForeignBatchInsert() would be able to use the libpq batching API, because it receives an array of tuples and can generate and issue INSERT statement for each tuple.  But I'm not sure either if the libpq batching is likely to be committed in the near future.  (The thread looks too long...)  Anyway, this thread's batch insert can be progressed (and hopefully committed), and once the libpq batching has been committed, we can give it a try to use it and modify postgres_fdw to see if we can get further performance boost.


Regards
Takayuki Tsunakawa


В списке pgsql-hackers по дате отправления
От: Andy Fan
Дата:
От: Kyotaro Horiguchi
Дата:
FAQ