Re: Avoiding deadlocks on mass delete / update

Craig Ringer wrote: <blockquote cite="mid:%3C4BA99567.6070502@postnewspapers.com.au%3E" type="cite"><pre wrap="">Роман
Машировwrote: </pre><blockquote type="cite"><pre wrap="">I've got a simple 'spool' table, one process 'worker' reads
andupdates
 
this table, other 'stat' performs 'delete ... where ... returning *'.
Sometimes I've got dedlocks on delete operation in 'stat', seems like at
the moment of expiration of data by timeout some state changes arrived
from worker. So the question, is it possible to somehow set order of row
deletion in such bulk delete operation, to avoid deadlocks?   </pre></blockquote><pre wrap="">
OK, so for the sake of example, WORKER is UPDATEing rows that stat is
trying to DELETE at the same time, such that worker holds a lock on row
A and wants a lock on row B, but stat holds B and wants A?

In other words, the deadlock is an _interaction_ between 'stat' and
'worker'? </pre></blockquote> yes<br /><blockquote cite="mid:%3C4BA99567.6070502@postnewspapers.com.au%3E"
type="cite"><prewrap="">
 
Can you post the queries? </pre></blockquote> as dumb as possible :) <br /><br /> worker parses several thousand events
anddo<br /> update queue set state=$1 where queue_id in (<id list>) and state in (<previous state list>)<br
/>for each target state, so it performs 1-4 update queries.<br /><br /> stat do<br /> delete from queue where
queue_stamp< now()-'1day'::interval or state in (<terminal state list>)<br /> returning *<br /><br /> The main
reasonfor such thing is to reduce amount of queries to perform, since this queue could work at about 50 objects per
secondwith 4 state changes.<br /><blockquote cite="mid:%3C4BA99567.6070502@postnewspapers.com.au%3E" type="cite"><pre
wrap="">Oneoption is to SELECT ... FOR UPDATE NOWAIT before your UPDATE or DELETE. </pre></blockquote> Yep, thank you
verymuch!<br /><br /> But, it would be good feature to somehow allow to explicitly set order of multi-row update /
delete,<br /> or to 'delete but locked', meaning delete all rows by given query parameters, except locked ones. <br
/><br/> --<br /> MRJ<br />