Re: High update activity, PostgreSQL vs BigDBMS

Поиск
Список
Период
Сортировка
Искать
От
Dave Cramer
Тема
Re: High update activity, PostgreSQL vs BigDBMS
Дата
Msg-id
86E1D954-72CB-4744-BF53-A7CB57623D83@fastcrypt.com
Ответ на
Список
Дерево обсуждения
High update activity, PostgreSQL vs BigDBMS Guy Rouillier <guyr-ml1@burntmail.com>
Re: High update activity, PostgreSQL vs BigDBMS Dave Cramer <pg@fastcrypt.com>
Re: High update activity, PostgreSQL vs BigDBMS "Alex Turner" <armtuk@gmail.com>
Re: High update activity, PostgreSQL vs BigDBMS Guy Rouillier <guyr-ml1@burntmail.com>
Re: High update activity, PostgreSQL vs BigDBMS "Shoaib Mir" <shoaibmir@gmail.com>
Re: High update activity, PostgreSQL vs BigDBMS Guy Rouillier <guyr-ml1@burntmail.com>
Re: High update activity, PostgreSQL vs BigDBMS "Craig A. James" <cjames@modgraph-usa.com>
Re: High update activity, PostgreSQL vs BigDBMS Guy Rouillier <guyr-ml1@burntmail.com>
Re: High update activity, PostgreSQL vs BigDBMS "Craig A. James" <cjames@modgraph-usa.com>
Re: High update activity, PostgreSQL vs BigDBMS Bruce Momjian <bruce@momjian.us>
Re: High update activity, PostgreSQL vs BigDBMS "Craig A. James" <cjames@modgraph-usa.com>
Re: High update activity, PostgreSQL vs BigDBMS "Adam Rich" <adam.r@sbcglobal.net>
Re: High update activity, PostgreSQL vs BigDBMS "Joshua D. Drake" <jd@commandprompt.com>
Re: High update activity, PostgreSQL vs BigDBMS "Adam Rich" <adam.r@sbcglobal.net>
Re: High update activity, PostgreSQL vs BigDBMS Tom Lane <tgl@sss.pgh.pa.us>
Re: High update activity, PostgreSQL vs BigDBMS "Adam Rich" <adam.r@sbcglobal.net>
Re: High update activity, PostgreSQL vs BigDBMS Shane Ambler <pgsql@007Marketing.com>
Re: High update activity, PostgreSQL vs BigDBMS Dave Cramer <pg@fastcrypt.com>
Re: High update activity, PostgreSQL vs BigDBMS Guy Rouillier <guyr-ml1@burntmail.com>
Re: High update activity, PostgreSQL vs BigDBMS "Joshua D. Drake" <jd@commandprompt.com>
Re: High update activity, PostgreSQL vs BigDBMS Dave Cramer <pg@fastcrypt.com>
Re: High update activity, PostgreSQL vs BigDBMS Guy Rouillier <guyr-ml1@burntmail.com>
Re: High update activity, PostgreSQL vs BigDBMS "Jim C. Nasby" <jim@nasby.net>
Re: High update activity, PostgreSQL vs BigDBMS Tom Lane <tgl@sss.pgh.pa.us>
Re: High update activity, PostgreSQL vs BigDBMS Guy Rouillier <guyr-ml1@burntmail.com>
Re: High update activity, PostgreSQL vs BigDBMS Ron <rjpeace@earthlink.net>
Re: High update activity, PostgreSQL vs BigDBMS Jeff Davis <pgsql@j-davis.com>
Re: High update activity, PostgreSQL vs BigDBMS Alvaro Herrera <alvherre@commandprompt.com>
Re: High update activity, PostgreSQL vs BigDBMS Geoffrey <esoteric@3times25.net>
Re: High update activity, PostgreSQL vs BigDBMS Ragnar <gnari@hive.is>
Re: High update activity, PostgreSQL vs BigDBMS Lars Heidieker <lars@heidieker.de>
Re: High update activity, PostgreSQL vs BigDBMS "Jeremy Haile" <jhaile@fastmail.fm>
Re: High update activity, PostgreSQL vs BigDBMS Jeff Frost <jeff@frostconsultingllc.com>
Re: High update activity, PostgreSQL vs BigDBMS "Jim C. Nasby" <jim@nasby.net>
Re: High update activity, PostgreSQL vs BigDBMS Jeff Frost <jeff@frostconsultingllc.com>
Re: High update activity, PostgreSQL vs BigDBMS "Jim C. Nasby" <jim@nasby.net>
Re: High update activity, PostgreSQL vs BigDBMS Jeff Frost <jeff@frostconsultingllc.com>
Re: High update activity, PostgreSQL vs BigDBMS Arnau <arnaulist@andromeiberica.com>
Re: High update activity, PostgreSQL vs BigDBMS Guy Rouillier <guyr-ml1@burntmail.com>

On 6-Jan-07, at 11:32 PM, Guy Rouillier wrote:

> Dave Cramer wrote:
>
>>>
>>> The box has 3 GB of memory.  I would think that BigDBMS would be  
>>> hurt by this more than PG.  Here are the settings I've modified  
>>> in postgresql.conf:
>> As I said you need to set shared_buffers to at least 750MB this is  
>> the starting point, it can actually go higher. Additionally  
>> effective cache should be set to 2.25 G turning fsync is not a  
>> real world situation. Additional tuning of file systems can  
>> provide some gain, however as Craig pointed out some queries may  
>> need to be tweaked.
>
> Dave, thanks for the hard numbers, I'll try them.  I agree turning  
> fsync off is not a production option.  In another reply to my  
> original posting, Alex mentioned that BigDBMS gets an advantage  
> from its async IO.  So simply as a test, I turned fsync off in an  
> attempt to open wide all the pipes.
>
> Regarding shared_buffers=750MB, the last discussions I remember on  
> this subject said that anything over 10,000 (8K buffers = 80 MB)  
> had unproven benefits.  So I'm surprised to see such a large value  
> suggested.  I'll certainly give it a try and see what happens.

That is 25% of your available memory. This is just a starting point.  
There are reports that going as high as 50% can be advantageous,  
however you need to measure it yourself.

>
>>>
>>> autovacuum=on
>>> stats_row_level = on
>>> max_connections = 10
>>> listen_addresses = 'db01,localhost'
>>> shared_buffers = 128MB
>>> work_mem = 16MB
>>> maintenance_work_mem = 64MB
>>> temp_buffers = 32MB
>>> max_fsm_pages = 204800
>>> checkpoint_segments = 30
>>> redirect_stderr = on
>>> log_line_prefix = '%t %d'
> -- 
> Guy Rouillier
>
> ---------------------------(end of  
> broadcast)---------------------------
> TIP 4: Have you searched our list archives?
>
>               http://archives.postgresql.org
>

В списке pgsql-performance по дате отправления
От: Shane Ambler
Дата:
От: Ben
Дата:
Сообщение: tweaking under repeatable load
FAQ