Обсуждение: Bucardo, BDR , pglogical

Поиск
Список
Период
Сортировка

Bucardo, BDR , pglogical

От
Firthouse banu
Дата:
Best tool to replicate a database to multiple servers and also when user do any changes in replicated database that too should be brought into master database . 

Master —— to multiple servers 
And in those servers if any changes done then should be bright those to master also . All database should be in sync…..

If anybody have supporting documents please do send me . And I need answers as well. 

Thanks 

RE: Bucardo, BDR , pglogical

От
Alvaro Aguayo
Дата:

Hi.

 

Until a few months ago, I was using BDR for a large database (> 600Gb). Worked pretty well. At the beginning hand some problems with large transactions, but solved them by adapting the program to use smaller transactions; never knew if it was a Postgres problem, a BDR problem, or if it was solved or is still causing trouble somewhere. Decided to stop using it because the release was old, it forced me to stay on PG9.4 and the newer releases were not free software, but commercial.

 

pglogical is based on the same technology as BDR, but it’s only master-slave. You might find some information about pglogical “multi-master” mode, but it’s just a way to make many masters converge into a single slave.

 

Never tried Bucardo, but, as far as I know, it’s trigger based, so I would not recommend it for nothing more than testing or small systems, as trigger-based replicators suffer from amplification and thus poor performance on high transaction concurrency.

 

If you are willing to pay, BDR is probably the better option. If not, you can always change your application to fit a different architecture. You can also consider some PostgreSQL-as-a-service such as the ones offered by Azure, AWS, or GPC, all of them offering high availability.

 

Regards,

 

Alvaro Aguayo

Operations Manager

Jr. Prolongación Ayacucho 177 Urb. Santa Eulalia - San Miguel

Telf. (+51-1) 680-5726

E-mail: aaguayo@ocs.pe

 

From: Firthouse banu <penguinsfairy@gmail.com>
Sent: 09 November 2021 08:22
To: pgsql-admin@postgresql.org
Subject: Bucardo, BDR , pglogical

 

Best tool to replicate a database to multiple servers and also when user do any changes in replicated database that too should be brought into master database . 

 

Master —— to multiple servers 

And in those servers if any changes done then should be bright those to master also . All database should be in sync…..

 

If anybody have supporting documents please do send me . And I need answers as well. 

 

Thanks 

 

Re: Bucardo, BDR , pglogical

От
Vijaykumar Jain
Дата:


On Tue, Nov 9, 2021, 6:52 PM Firthouse banu <penguinsfairy@gmail.com> wrote:
Best tool to replicate a database to multiple servers and also when user do any changes in replicated database that too should be brought into master database . 

Master —— to multiple servers 
And in those servers if any changes done then should be bright those to master also . All database should be in sync…..

What is your use case that only a multimaster setup can solve the problem and not a simple primary replica setup.

BTW, 


Hello Community!

One of my Postgresql servers has been over the years through "in-place" update for last 6 years or so.  Currently stands at 18.04 w/ Postgres-12-Postgis 3.1, the server went through multiple version os Ubuntu and PostgreSQL .

I am trying to upgrade Ubuntu to 20.04 first before upgrading PostgreSQL, but failed with OS upgrade.  Here are the last few lines in /var/log/dist-upgrade/main.log after failed upgrade:

2021-11-09 08:35:50,044 DEBUG blacklist expr '^postgresql-.*[0-9][0-9].*' matches 'postgresql-12-postgis-3'
2021-11-09 08:35:50,044 DEBUG The package 'postgresql-12-postgis-3' is marked for removal but it's in the removal blacklist
2021-11-09 08:35:50,053 ERROR Dist-upgrade failed: 'The package 'postgresql-12-postgis-3' is marked for removal but it is in the removal blacklist.'
2021-11-09 08:35:50,055 DEBUG abort called

The offending package  'postgresql-12-postgis-3' corresponds my current Postgresql version.  Should I remove the package and proceed with OS upgrade?  I am at a loss... 

Thanks!

Bo


On 11/9/21 10:23 AM, Bo Guo wrote:

Hello Community!

One of my Postgresql servers has been over the years through "in-place" update for last 6 years or so.  Currently stands at 18.04 w/ Postgres-12-Postgis 3.1, the server went through multiple version os Ubuntu and PostgreSQL .

I am trying to upgrade Ubuntu to 20.04 first before upgrading PostgreSQL, but failed with OS upgrade.  Here are the last few lines in /var/log/dist-upgrade/main.log after failed upgrade:

2021-11-09 08:35:50,044 DEBUG blacklist expr '^postgresql-.*[0-9][0-9].*' matches 'postgresql-12-postgis-3'
2021-11-09 08:35:50,044 DEBUG The package 'postgresql-12-postgis-3' is marked for removal but it's in the removal blacklist
2021-11-09 08:35:50,053 ERROR Dist-upgrade failed: 'The package 'postgresql-12-postgis-3' is marked for removal but it is in the removal blacklist.'
2021-11-09 08:35:50,055 DEBUG abort called

The offending package  'postgresql-12-postgis-3' corresponds my current Postgresql version.  Should I remove the package and proceed with OS upgrade?  I am at a loss... 


What repository did you install it from? 

--
Angular momentum makes the world go 'round.

Ron,

Ubuntu release upgrade (do-release-upgrade) uses Ubuntu official repository, I believe.

Bo

On 11/9/21 10:16 AM, Ron wrote:
On 11/9/21 10:23 AM, Bo Guo wrote:

Hello Community!

One of my Postgresql servers has been over the years through "in-place" update for last 6 years or so.  Currently stands at 18.04 w/ Postgres-12-Postgis 3.1, the server went through multiple version os Ubuntu and PostgreSQL .

I am trying to upgrade Ubuntu to 20.04 first before upgrading PostgreSQL, but failed with OS upgrade.  Here are the last few lines in /var/log/dist-upgrade/main.log after failed upgrade:

2021-11-09 08:35:50,044 DEBUG blacklist expr '^postgresql-.*[0-9][0-9].*' matches 'postgresql-12-postgis-3'
2021-11-09 08:35:50,044 DEBUG The package 'postgresql-12-postgis-3' is marked for removal but it's in the removal blacklist
2021-11-09 08:35:50,053 ERROR Dist-upgrade failed: 'The package 'postgresql-12-postgis-3' is marked for removal but it is in the removal blacklist.'
2021-11-09 08:35:50,055 DEBUG abort called

The offending package  'postgresql-12-postgis-3' corresponds my current Postgresql version.  Should I remove the package and proceed with OS upgrade?  I am at a loss... 


What repository did you install it from? 

--
Angular momentum makes the world go 'round.
-- 
Regards,

Bo Guo, PhD, PE
President
Gistic Research, Inc.
2033 E Warner Rd Ste 105
Tempe, AZ 85284
www.gisticinc.com
www.youtube.com/linearbench
Office: 480-656-9962
Cell: 602-570-4697
The "it" is postgresql-12-postgis-3, since that's what you're having trouble with.

On 11/9/21 11:50 AM, Bo Guo wrote:

Ron,

Ubuntu release upgrade (do-release-upgrade) uses Ubuntu official repository, I believe.

Bo

On 11/9/21 10:16 AM, Ron wrote:
On 11/9/21 10:23 AM, Bo Guo wrote:

Hello Community!

One of my Postgresql servers has been over the years through "in-place" update for last 6 years or so.  Currently stands at 18.04 w/ Postgres-12-Postgis 3.1, the server went through multiple version os Ubuntu and PostgreSQL .

I am trying to upgrade Ubuntu to 20.04 first before upgrading PostgreSQL, but failed with OS upgrade.  Here are the last few lines in /var/log/dist-upgrade/main.log after failed upgrade:

2021-11-09 08:35:50,044 DEBUG blacklist expr '^postgresql-.*[0-9][0-9].*' matches 'postgresql-12-postgis-3'
2021-11-09 08:35:50,044 DEBUG The package 'postgresql-12-postgis-3' is marked for removal but it's in the removal blacklist
2021-11-09 08:35:50,053 ERROR Dist-upgrade failed: 'The package 'postgresql-12-postgis-3' is marked for removal but it is in the removal blacklist.'
2021-11-09 08:35:50,055 DEBUG abort called

The offending package  'postgresql-12-postgis-3' corresponds my current Postgresql version.  Should I remove the package and proceed with OS upgrade?  I am at a loss... 


What repository did you install it from? 

--
Angular momentum makes the world go 'round.
-- 
Regards,

Bo Guo, PhD, PE
President
Gistic Research, Inc.
2033 E Warner Rd Ste 105
Tempe, AZ 85284
www.gisticinc.com
www.youtube.com/linearbench
Office: 480-656-9962
Cell: 602-570-4697

--
Angular momentum makes the world go 'round.

Re: Ubuntu Upgrade from 18.04 to 20.04 failed due to Postgres/Postgis package on removal blacklist.

От
Holger Jakobs
Дата:
Am 09.11.21 um 18:50 schrieb Bo Guo:

Ron,

Ubuntu release upgrade (do-release-upgrade) uses Ubuntu official repository, I believe.

Bo

On 11/9/21 10:16 AM, Ron wrote:
On 11/9/21 10:23 AM, Bo Guo wrote:

Hello Community!

One of my Postgresql servers has been over the years through "in-place" update for last 6 years or so.  Currently stands at 18.04 w/ Postgres-12-Postgis 3.1, the server went through multiple version os Ubuntu and PostgreSQL .

I am trying to upgrade Ubuntu to 20.04 first before upgrading PostgreSQL, but failed with OS upgrade.  Here are the last few lines in /var/log/dist-upgrade/main.log after failed upgrade:

2021-11-09 08:35:50,044 DEBUG blacklist expr '^postgresql-.*[0-9][0-9].*' matches 'postgresql-12-postgis-3'
2021-11-09 08:35:50,044 DEBUG The package 'postgresql-12-postgis-3' is marked for removal but it's in the removal blacklist
2021-11-09 08:35:50,053 ERROR Dist-upgrade failed: 'The package 'postgresql-12-postgis-3' is marked for removal but it is in the removal blacklist.'
2021-11-09 08:35:50,055 DEBUG abort called

The offending package  'postgresql-12-postgis-3' corresponds my current Postgresql version.  Should I remove the package and proceed with OS upgrade?  I am at a loss... 


What repository did you install it from? 

--
Angular momentum makes the world go 'round.
-- 
Regards,

Bo Guo, PhD, PE
President
Gistic Research, Inc.
2033 E Warner Rd Ste 105
Tempe, AZ 85284
www.gisticinc.com
www.youtube.com/linearbench
Office: 480-656-9962
Cell: 602-570-4697

I would strongly recommend to use the repository of the PostgreSQL Developer Group: https://www.postgresql.org/download/linux/ubuntu/

This makes your OS upgrades and the PostgreSQL updates more independent of each other. Plus, you always can get the latest PostgreSQL version, while the distribution repositories only offer the current version as of its publishing. So, Ubuntu 20.04 only has the 2019 version of PostgreSQL.

-- 

Holger Jakobs, Bergisch Gladbach, Tel. +49-178-9759012
Вложения

AW: Ubuntu Upgrade from 18.04 to 20.04 failed due to Postgres/Postgis package on removal blacklist.

От
"Dischner, Anton"
Дата:

Hi,

 

maybe a force install does the trick.

 

apt-get -f install

 

I know normally this is for unresolved dependencies but its worth a try.

 

Also see: https://askubuntu.com/questions/140247/force-install-apt-get

 

Yes i would try to remove the offending package postgresql-12-postgis-3, but make shure you can restore: snapshot or verified backup.

 

best,

 

A

 

Von: Holger Jakobs <holger@jakobs.com>
Gesendet: Dienstag, 9. November 2021 20:33
An: pgsql-admin@lists.postgresql.org
Betreff: Re: Ubuntu Upgrade from 18.04 to 20.04 failed due to Postgres/Postgis package on removal blacklist. [signed INVALID]

 

Am 09.11.21 um 18:50 schrieb Bo Guo:

Ron,

Ubuntu release upgrade (do-release-upgrade) uses Ubuntu official repository, I believe.

Bo

On 11/9/21 10:16 AM, Ron wrote:

On 11/9/21 10:23 AM, Bo Guo wrote:

Hello Community!

One of my Postgresql servers has been over the years through "in-place" update for last 6 years or so.  Currently stands at 18.04 w/ Postgres-12-Postgis 3.1, the server went through multiple version os Ubuntu and PostgreSQL .

I am trying to upgrade Ubuntu to 20.04 first before upgrading PostgreSQL, but failed with OS upgrade.  Here are the last few lines in /var/log/dist-upgrade/main.log after failed upgrade:

2021-11-09 08:35:50,044 DEBUG blacklist expr '^postgresql-.*[0-9][0-9].*' matches 'postgresql-12-postgis-3'
2021-11-09 08:35:50,044 DEBUG The package 'postgresql-12-postgis-3' is marked for removal but it's in the removal blacklist
2021-11-09 08:35:50,053 ERROR Dist-upgrade failed: 'The package 'postgresql-12-postgis-3' is marked for removal but it is in the removal blacklist.'
2021-11-09 08:35:50,055 DEBUG abort called

The offending package  'postgresql-12-postgis-3' corresponds my current Postgresql version.  Should I remove the package and proceed with OS upgrade?  I am at a loss... 


What repository did you install it from? 

--

Angular momentum makes the world go 'round.

-- 
Regards,
 
Bo Guo, PhD, PE
President
Gistic Research, Inc.
2033 E Warner Rd Ste 105
Tempe, AZ 85284
www.gisticinc.com
www.youtube.com/linearbench
Office: 480-656-9962
Cell: 602-570-4697

I would strongly recommend to use the repository of the PostgreSQL Developer Group: https://www.postgresql.org/download/linux/ubuntu/

This makes your OS upgrades and the PostgreSQL updates more independent of each other. Plus, you always can get the latest PostgreSQL version, while the distribution repositories only offer the current version as of its publishing. So, Ubuntu 20.04 only has the 2019 version of PostgreSQL.

-- 
 
Holger Jakobs, Bergisch Gladbach, Tel. +49-178-9759012