Re: Adding a pgbench run to buildfarm

"Bort, Paul" <pbort@tmwsystems.com> writes:
> Andrew said I should solicit opinions as to what parameters to use. A
> cursory search through the archives led me to pick a scaling factor of
> 10, 5 users, and 100 transactions.

100 transactions seems barely enough to get through startup transients.
Maybe 1000 would be good.

I think the hard part of this is the reporting process.  How do we
track how performance varies over time?  It doesn't seem very useful
to compare different buildfarm members, but a longitudinal display of
performance on a single buildfarm machine over time would be cool.
(I'm still missing Mark Wong's daily OSDL performance reports :-()

Actually the $64 question here is whether we trust pgbench as the
standard performance test ...
        regards, tom lane