Re: Memory-Bounded Hash Aggregation

Поиск
Список
Период
Сортировка
Искать
От
Jeff Davis
Тема
Re: Memory-Bounded Hash Aggregation
Дата
Msg-id
d979f79527245f9380d0601964230a16a101beb9.camel@j-davis.com
Ответ на
Список
Дерево обсуждения
Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Adam Lee <ali@pivotal.io>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Taylor Vesely <tvesely@pivotal.io>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Adam Lee <ali@pivotal.io>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Adam Lee <ali@pivotal.io>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Adam Lee <ali@pivotal.io>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Andres Freund <andres@anarazel.de>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Melanie Plageman <melanieplageman@gmail.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Adam Lee <ali@pivotal.io>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Heikki Linnakangas <hlinnaka@iki.fi>
Re: Memory-Bounded Hash Aggregation Melanie Plageman <melanieplageman@gmail.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Adam Lee <ali@pivotal.io>
Re: Memory-Bounded Hash Aggregation Adam Lee <ali@pivotal.io>
Re: Memory-Bounded Hash Aggregation Andres Freund <andres@anarazel.de>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Andres Freund <andres@anarazel.de>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Andres Freund <andres@anarazel.de>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Justin Pryzby <pryzby@telsasoft.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Justin Pryzby <pryzby@telsasoft.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Pengzhou Tang <ptang@pivotal.io>
Re: Memory-Bounded Hash Aggregation Pengzhou Tang <ptang@pivotal.io>
Re: Memory-Bounded Hash Aggregation Richard Guo <guofenglinux@gmail.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Melanie Plageman <melanieplageman@gmail.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Peter Geoghegan <pg@bowt.ie>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Adam Lee <ali@pivotal.io>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Peter Geoghegan <pg@bowt.ie>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Peter Geoghegan <pg@bowt.ie>
Re: Memory-Bounded Hash Aggregation Thomas Munro <thomas.munro@gmail.com>
Re: Memory-Bounded Hash Aggregation Heikki Linnakangas <hlinnaka@iki.fi>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Heikki Linnakangas <hlinnaka@iki.fi>
Re: Memory-Bounded Hash Aggregation Peter Geoghegan <pg@bowt.ie>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
Re: Memory-Bounded Hash Aggregation Jeff Davis <pgsql@j-davis.com>
On Sat, 2019-12-14 at 18:32 +0100, Tomas Vondra wrote:
> So I think we're not costing the batching properly / at all.

Thank you for all of the testing! I think the results are good: even
for cases where HashAgg is the wrong choice, it's not too bad. You're
right that costing is not done, and when it is, I think it will avoid
these bad choices most of the time.

> A couple more comments:
> 
> 1) IMHO we should rename hashagg_mem_overflow to
> enable_hashagg_overflow
> or something like that. I think that describes the GUC purpose better
> (and it's more consistent with enable_hashagg_spill).

The other enable_* GUCs are all planner GUCs, so I named this one
differently to stand out as an executor GUC.

> 2) show_hashagg_info
> 
> I think there's a missing space after ":" here:
> 
> 				"  Batches: %d  Disk Usage:%ldkB",
> 
> and maybe we should use just "Disk:" just like in we do for sort:

Done, thank you.

> 3) I'm not quite sure what to think about the JIT recompile we do for
> EEOP_AGG_INIT_TRANS_SPILLED etc. I'm no llvm/jit expert, but do we do
> that for some other existing cases?

Andres asked for that explicitly to avoid branches in the non-spilling
code path (or at least branches that are likely to be mispredicted).

Regards,
	Jeff Davis




В списке pgsql-hackers по дате отправления
От: Jeff Davis
Дата:
От: tsunakawa.takay@fujitsu.com
Дата:
FAQ