Subject | Re: [ib-support] firebird vs IB |
---|---|
Author | Paul Reeves |
Post date | 2002-02-21T09:25:28Z |
Martijn Tonies wrote:
slightest difference. The test suite is flawed for many reasons. For
one, it only tests what it knows about. If there is no test to verify
the order of constraint/trigger firing then there is no way the suite
can 'fail'.
More seriously the fundamental principle of the test suite is based on
comparing output from a test with stored output from a previous test
run. There is no way of validating whether the test itself is valid, or
whether the output itself is valid, beyond a QA engineer's say so.
The test suite is not entirely meaningless - it can catch things where a
new build may have regressed existing functionality - but overall it is
nothing when compared with the twenty thousand downloads of Firebird 1.0
RC2. The open source development model allows Firebird to be tested in
constant daily use world-wide and for reasonably rapid fixes to be
delivered when serious bugs are found.
Paul
--
Paul Reeves
http://www.ibphoenix.com
taking InterBase further
>IMO you can run IB against the test suite for weeks and it wont make the
>
> It's better than IB 6.5 -- IB 6.5 (supposedly tested for a couple of
> days/longer? in the test suites) has the CHECK CONSTRAINT fires before
> BEFORE INSERT trigger bug! Isn't that terrible!
>
slightest difference. The test suite is flawed for many reasons. For
one, it only tests what it knows about. If there is no test to verify
the order of constraint/trigger firing then there is no way the suite
can 'fail'.
More seriously the fundamental principle of the test suite is based on
comparing output from a test with stored output from a previous test
run. There is no way of validating whether the test itself is valid, or
whether the output itself is valid, beyond a QA engineer's say so.
The test suite is not entirely meaningless - it can catch things where a
new build may have regressed existing functionality - but overall it is
nothing when compared with the twenty thousand downloads of Firebird 1.0
RC2. The open source development model allows Firebird to be tested in
constant daily use world-wide and for reasonably rapid fixes to be
delivered when serious bugs are found.
Paul
--
Paul Reeves
http://www.ibphoenix.com
taking InterBase further