Passing Tests Should PASS
Passing Tests Should PASS
●
One must trust their test suite, else it will be ignored.
●
When it fails, it should indicate a real problem.
●
"Expected failures" sap that trust.
▶
"Oh, don't worry, that test always fails on Redhat 6.2"
▶
If a failure sometimes isn't really a failure, when do you know a real
failure?
●
"Expected failures" make test automation impossible.
▶
Programs don't know "well, the test failed but it really passed"
▶
Joe CPAN module installer also doesn't know that.
●
Get your test suite at 100% and keep it there.
▶
That's worth saying again.
●
STAY AT 100% PASSING!