Re: [ADMIN] Database corrupted - PSQL 9.3 Ubuntu Server 14.04

On 15/12/2016 17:07, Sébastien Beausoleil wrote:
> Hi,
> I have a big problem with one of my Postgresql server.
> I started a standard package update and during the Postgresql update, something happen that it make it fails. Since
when,postgresql isn't able to start. 
> In the log, here is what it is showed:
What postgresql update ?
>
> 2016-12-15 08:40:03 EST FATAL:  "/var/lib/postgresql/9.3/main" is not a valid data directory
> 2016-12-15 08:40:03 EST DETAIL:  File "/var/lib/postgresql/9.3/main/PG_VERSION" is missing.
>
> And if I go further, there is a reccuring message:
>
> 2016-12-14 22:01:14 EST FATAL:  could not open relation mapping file "global/pg_filenode.map": No such file or
directory
> 2016-12-14 22:01:15 EST ERROR:  could not open file "base/305852/11848": No such file or directory
> 2016-12-14 22:01:15 EST CONTEXT:  writing block 0 of relation base/305852/11848
> 2016-12-14 22:01:15 EST WARNING:  could not write block 0 of base/305852/11848
> 2016-12-14 22:01:15 EST DETAIL:  Multiple failures --- write error might be permanent.
>
>
> I notice, when comparing with a similare server, that 3 db data in the main/base folder are empty, I suppose it's the
postgres,template0 et template1 database. 
That's pretty bad. Can you locate them anywhere else in your file system?
>
> I try pg_resetxlog on a copy of the data dir, the server came up but the "postgres" user isn't a valide role...
>
> I had a cron which make dump backup each day but there was un bug in the script that make it right, so I know we
shouldnot rely on recovery, but by now, It s really my only hope. 
Do you take any file system backup by pg_start_backup/pg_stop_backup ? or pg_basebackup? or WAL archiving?
>
> Could someone help me?
>
> Sebastien
>
>
> OS: Ubuntu Server 14.04 64bit
> Postgresql: 9.3
>
>
>
>
>


--
Achilleas Mantzios
IT DEV Lead
IT DEPT
Dynacom Tankers Mgmt