Re: Offline enabling/disabling of data checksums

Поиск
Список
Период
Сортировка
Искать
От
Fabien COELHO
Тема
Re: Offline enabling/disabling of data checksums
Дата
Msg-id
alpine.DEB.2.21.1903131037240.4059@lancre
Ответ на
Список
Дерево обсуждения
Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Robert Haas <robertmhaas@gmail.com>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Stephen Frost <sfrost@snowman.net>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Sergei Kornilov <sk@zsrv.org>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Andres Freund <andres@anarazel.de>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Andres Freund <andres@anarazel.de>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Andres Freund <andres@anarazel.de>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Andres Freund <andres@anarazel.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <fabien.coelho@mines-paristech.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Christoph Berg <myon@debian.org>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Andres Freund <andres@anarazel.de>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Sergei Kornilov <sk@zsrv.org>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Sergei Kornilov <sk@zsrv.org>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Sergei Kornilov <sk@zsrv.org>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Christoph Berg <myon@debian.org>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Sergei Kornilov <sk@zsrv.org>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Sergei Kornilov <sk@zsrv.org>
Re: Offline enabling/disabling of data checksums Fabien COELHO <fabien.coelho@mines-paristech.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Andres Freund <andres@anarazel.de>
Re: Offline enabling/disabling of data checksums Michael Paquier <michael@paquier.xyz>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Bernd Helmle <mailings@oopsware.de>
Re: Offline enabling/disabling of data checksums Michael Banck <michael.banck@credativ.de>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Bernd Helmle <mailings@oopsware.de>
Re: Offline enabling/disabling of data checksums Fabien COELHO <coelho@cri.ensmp.fr>
Re: Offline enabling/disabling of data checksums Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Offline enabling/disabling of data checksums Magnus Hagander <magnus@hagander.net>

>> I do not think it is a good thing that two commands can write to the data
>> directory at the same time, really.
>
> We don't prevent either a pg_resetwal and a pg_basebackup to run in
> parallel.  That would be...  Interesting.

Yep, I'm trying again to suggest that this kind of thing should be 
prevented. It seems that I'm pretty unconvincing.

>> About fsync-ing: ISTM that it is possible that the control file is written
>> to disk while data are still not written, so a failure in between would
>> leave the cluster with an inconsistent state. I think that it should fsync
>> the data *then* update the control file and fsync again on that one.
>
> if --enable is used, we fsync the whole data directory after writing
> all the blocks and updating the control file at the end. [...]
> It could be possible to reach a state where the control file has 
> checksums enabled and some blocks are not correctly synced, still you 
> would notice rather quickly if the server is in an incorrect state at 
> the follow-up startup.

Yep. That is the issue I think is preventable by fsyncing updated data 
*then* writing & syncing the control file, and that should be done by
pg_checksums.

-- 
Fabien.

В списке pgsql-hackers по дате отправления
От: Michael Paquier
Дата:
От: Amit Langote
Дата:
FAQ