Sunday, December 3, 2023

A Test Is Not a Metric

 

A test execution by human or automation will provide information to be aware & learn.

If there is a metric, it should be for what I got to be aware of & learned.  Not for the number of tests.  If it is for a test, it is blunder, before taking it as a metric.

One can identify infinite tests; automate adding annotation @test in big numbers. Should this number be a metric?

That is a question to ask when you see a metric on this number.


What is of value to you in this outcome from a test?  That value should have a metric, and not test or the number of tests.


Identifying the metric in a context which serves, is not easy.

Number of pass/fail or green/red is a measurement; not a metric!

Anything measured cannot be a metric.


A metric helps to measure in a way that establishes rational correlation & upholds its necessity in business.


Share this awareness!