Re: Two weeks to feature freeze

Dann Corbit wrote:
> That is the worst possible test plan.  It totally lacks organization and
> there is no hint to define when the feature set has been covered.  Ad
> hoc testing is a useful addition, but it cannot replace all the standard
> tests that have been used by the industry for decades.
> 
> If you run literally hundreds of tests designed to ensure that your
> product conforms to ANSI/ISO standards then the bugs that are missed
> will be few and far between.  Unless you are bad at designing tests.
> 
> Designing tests is busywork.  Desiging tests is boring.  Nobody wants to
> design tests, let alone interpret the results and define correct
> baselines.  But testing is very, very important.

I remember when I was with Great Bridge they said, "Oh, we are going to
have a test setup and do all sorts of testing to improve PostgreSQL."  I
told them I doubted their testing was going to shake out many more bugs
than our existing testing setup, and you know what, I was pretty much
right.  Sure, they found a few, but it wasn't much.

--  Bruce Momjian                        |  http://candle.pha.pa.us pgman@candle.pha.pa.us               |  (610)
359-1001+  If your life is a hard drive,     |  13 Roberts Road +  Christ can be your backup.        |  Newtown Square,
Pennsylvania19073