Re: POC: Cache data in GetSnapshotData()

Поиск
Список
Период
Сортировка
От Amit Kapila
Тема Re: POC: Cache data in GetSnapshotData()
Дата
Msg-id CAA4eK1JD=ta9thMfGfHx06hkK9qf1W5RXWuxwYW8r9YnHzPq0Q@mail.gmail.com
обсуждение исходный текст
Ответ на Re: POC: Cache data in GetSnapshotData()  (Mithun Cy <mithun.cy@enterprisedb.com>)
Ответы Re: POC: Cache data in GetSnapshotData()  (Mithun Cy <mithun.cy@enterprisedb.com>)
Список pgsql-hackers
On Thu, Mar 10, 2016 at 1:04 PM, Mithun Cy <mithun.cy@enterprisedb.com> wrote:


On Thu, Mar 3, 2016 at 11:50 PM, Robert Haas <robertmhaas@gmail.com> wrote:
>What if you apply both this and Amit's clog control log patch(es)?  Maybe the combination of the two helps substantially more than either >one alone.


I did the above tests along with Amit's clog patch. Machine :8 socket, 64 core. 128 hyperthread.

clientsBASEONLY CLOG CHANGES% IncreaseONLY SAVE SNAPSHOT% IncreaseCLOG CHANGES + SAVE SNAPSHOT% Increase
6429247.65803430855.7288355.498118171129254.5321860.023503256232691.83277611.7758992463
8831214.30539133313.3930956.724761860632109.2486092.867093170235433.65520313.5173592978
12830896.67394934015.36215210.0939285832******34947.29635513.110221549
25627183.78092131192.89543714.7481857938******32873.78273520.9316056164

With clog changes, perf of caching the snapshot patch improves.


This data looks promising to me and indicates that saving the snapshot has benefits and we can see noticeable performance improvement especially once the CLog contention gets reduced.  I wonder if we should try these tests with unlogged tables, because I suspect most of the contention after CLogControlLock and ProcArrayLock is for WAL related locks, so you might be able to see better gain with these patches.  Do you think it makes sense to check the performance by increasing CLOG buffers (patch for same is posted in Speed up Clog thread [1]) as that also relieves contention on CLOG as per the tests I have done?


В списке pgsql-hackers по дате отправления:

Предыдущее
От: Michael Paquier
Дата:
Сообщение: Re: pg_rewind just doesn't fsync *anything*?
Следующее
От: Amit Langote
Дата:
Сообщение: Re: [PROPOSAL] VACUUM Progress Checker.