Re: Largest PG database known to man!

On 10/1/2013 3:00 PM, Mark Jones wrote:
> >From the limited information, it is mostly relational.

phew.   thats going to be a monster.    400TB on 600GB 15000rpm SAS
drives in raid10 will require around 1400 drives.   at 25 disks per 2U
drive tray, thats 2 6' racks of nothing but disks, and to maintain a
reasonable fanout to minimize IO bottlenecks, would require on the order
of 25 SAS raid cards.   or, a really big SAN with some serious IOPS.
and naturally, you should have at least 2 of these for availability.

if we assume the tables average 1KB/record (which is a fairly large
record size even including indexing), you're looking at 400 billion
records.   if you can populate these at 5000 records/second, it would
take 2.5 years of 24/7 operation to populate that.

this sort of big data system is probably more suitable for something
like hadoop+mongo or whatever on a cloud of 1000 nodes, not a monolithic
SQL relational database.


--
john r pierce                                      37N 122W
somewhere on the middle of the left coast