Re: Logical Replication speed-up initial data

Поиск
Список
Период
Сортировка
От Vijaykumar Jain
Тема Re: Logical Replication speed-up initial data
Дата
Msg-id CAM+6J9755_BDWn+uF=HsYJxAWrcn8U_o41qFfPCM63HY0Y6BuQ@mail.gmail.com
обсуждение исходный текст
Ответ на Re: Logical Replication speed-up initial data  (Nikhil Shetty <nikhil.dba04@gmail.com>)
Ответы Re: Logical Replication speed-up initial data
Re: Logical Replication speed-up initial data
Список pgsql-performance
On Thu, 5 Aug 2021 at 10:27, Nikhil Shetty <nikhil.dba04@gmail.com> wrote:
Hi,

Thank you for the suggestion.

We tried by dropping indexes and it worked faster compared to what we saw earlier. We wanted to know if anybody has done any other changes that helps speed-up initial data load without dropping indexes.


PS: i have not tested this in production level loads, it was just some exp i did on my laptop.

one option would be to use pglogical extension (this was shared by Dharmendra in one the previous mails, sharing the same),
and then use pglogical_create_subscriber cli to create the initial copy via pgbasebackup and then carry on from there.
I ran the test case similar to one below in my local env, and it seems to work fine. of course i do not have TB worth of load to test, but it looks promising,
especially since they introduced it to the core.
Once you attain some reasonable sync state, you can drop the pglogical extension, and check if things continue fine.
I have done something similar when upgrading from 9.6 to 11 using pglogical and then dropping the extension and it was smooth,
maybe you need to try this out and share if things works fine.
and 

В списке pgsql-performance по дате отправления:

Предыдущее
От: Rick Otten
Дата:
Сообщение: Re: Logical Replication speed-up initial data
Следующее
От: Avinash Kumar
Дата:
Сообщение: Re: Logical Replication speed-up initial data