Re: Weird glitches for N messages sent to list simultaneously

* Tom Lane (tgl@sss.pgh.pa.us) wrote:
> I've been noticing this for quite awhile: if I commit to all active
> branches, that causes N (currently 6) messages to be sent to
> pgsql-committers at once.  Very often, only N-1 or N-2 of those messages
> come back promptly; the rest are delayed for periods of minutes.
> (It seems like they will come through if someone else posts a message
> to some PG list, though I wouldn't want to swear there is a connection.
> Otherwise it can take quite a few minutes.)
>
> I noticed this just now with respect to f64340e7436d0f84 et al, and
> thought to look at the mail archives page for pgsql-committers, where
> I see just four messages, same as what came back to me.  So it's not
> just me; there is something odd going on in message submission.
> Anybody care to speculate what?

Unfortunately, this appears to be "something odd happening in
Majordomo."  I've checked the exim logs, and the messages are all
delivered to majordomo at the same time, and I see them show up in mj2's
"enqueue" debug log all at the same time.

From the exim logs, the outbound messages for the delayed ones are
received by exim after the delay, so it's clearly something in mj2 land.

What it looks like is that, when a message comes in, mj2 does a queue
run, which will happily process everything in the queue that it sees
when it starts up, but if messages come in while the queue is being run
they seem to get missed until the next queue run, which isn't happening
til the next email arrives.

I've got basically no idea why it isn't immediately re-running the
queue when it finishes, or why there isn't some other process to kick it
when there's messages in the queue to be processed..

Looks like Alvaro is taking a look at it also, perhaps he'll have more
insight into what's happening inside mj2.

Thanks!

Stephen