Re: Two weeks to feature freeze

> -----Original Message-----
> From: Tom Lane [mailto:tgl@sss.pgh.pa.us]
> Sent: Friday, June 20, 2003 8:36 PM
> To: Dann Corbit
> Cc: Jason Earl; PostgreSQL-development
> Subject: Re: [HACKERS] Two weeks to feature freeze
>
>
> "Dann Corbit" <DCorbit@connx.com> writes:
> > If there is no procedure for PostgreSQL of this nature, then there
> > really needs to be.
>
> Are you volunteering to create it?  Step right up.

No.  And as an outsider, I rather doubt if any procedures I developed
would be taken very seriously.  If such procedures are to be developed,
I suspect that they will have to be developed from within if they are to
be successful.

This would be a good start:

A.  Combine:1.  Your regression test2.  Crashme (or some rough equivalent if you don't like it)3.  The NIST validation
testsuite 
B.  Automate:1.  Installation of the tests2.  Execution of the tests3.  Transfer of the test results to a repository4.
Analysisof the test results 
C.  Assign:1.  Criteria for acceptance of a build for release2.  Authority for acceptance of a build for release3.
Delegationrules for issue resolution4.  Procedures for issue resolution 
> > I am sure that MySQL must have something in place
> > like that.  Their "Crash-Me" test suite shows (at least) that they
> > have put a large effort into testing.
>
> ...ROTFL...  Crash-Me is not a regression test.  It is a
> marketing effort.

Let's see...
Their marketing effort checks for STANDARDS conformance against over
several hundred distinct, important properties.
Their marketing effort checks for a number of interesting and valuable
extensions.
Their marketing effort checks for system safety in a manner that is
better than anything I have ever seen from a commercial vendor.

And the PostgreSQL regression test is superior in what ways?

Look at this:
http://www.mysql.com/information/crash-me.php?mysql_4_1=on&postgres=on

Their marketing effort makes PostgreSQL look superior to MySQL in most
areas.  If it is a marketing effort, then we must applaud them for their
honesty.