Re: Performance problems testing with Spamassassin 3.1.0

On Fri, 2005-07-29 at 09:37 -0800, Matthew Schumacher wrote:
> >
> > On my laptop this takes:
> >
> > real    1m33.758s
> > user    0m4.285s
> > sys     0m1.181s
> >
> > One interesting effect is the data in bayes_vars has a huge number of
> > updates and needs vacuum _frequently_.  After the run a vacuum full
> > compacts it down from 461 pages to 1 page.
> >
>
> I wonder why your laptop is so much faster.  My 2 min 30 sec test was
> done on a dual xeon with a LSI megaraid with 128MB cache and writeback
> caching turned on.

I only do development stuff on my laptop, and all of my databases are
reconstructable from copies, etc...  so I turn off fsync in this case.


> How often should this table be vacuumed, every 5 minutes?

I would be tempted to vacuum after each e-mail, in this case.


> Also, this test goes a bit faster with sync turned off, if mysql isn't
> using sync that would be why it's so much faster.  Anyone know what the
> default for mysql is?

It depends on your table type for MySQL.

For the data in question (i.e. bayes scoring) it would seem that not
much would be lost if you did have to restore your data from a day old
backup, so perhaps fsync=false is OK for this particular application.

Regards,
                    Andrew McMillan.

-------------------------------------------------------------------------
Andrew @ Catalyst .Net .NZ  Ltd,  PO Box 11-053, Manners St,  Wellington
WEB: http://catalyst.net.nz/            PHYS: Level 2, 150-154 Willis St
DDI: +64(4)803-2201      MOB: +64(272)DEBIAN      OFFICE: +64(4)499-2267
  What we wish, that we readily believe.
                                     -- Demosthenes
-------------------------------------------------------------------------