Re: CSV arm check failure

Tom Lane wrote:

>I have noticed an increasing tendency among the buildfarm crew to think
>that the regression tests should show zero diffs on all platforms no
>matter what.  That is not the design goal.  The intent is to tell you
>about possible problems.  If you decide that a particular diff isn't
>really a problem, fine, but that doesn't mean we should mask the same
>symptom everywhere.
>
>
>  
>

I don't want to mask anything that shouldn't be. I made the suggestion 
in this particular case because we already have a number of alternative 
result files caused by FP differences.

The buildfarm is a dashboard application - when everything is OK you 
want it to show all green. If that's not a goal, then some redesign is 
appropriate. Perhaps buildfarm needs its own test suite, rather than 
leveraging those in the distribution, although that would be a pity, to 
say the least.

cheers

andrew