Test trend analysis: towards robust, reliable and timely tests

In this talk you will get ideas about how you can instrument test result information to provide actionable data, paving the way for more robust, reliable and timely test results.

By capturing this information over time, and when combined with visualization tools, we can answer different questions than with existing solutions (Allure/CI tool build history). Some examples of these are:

– Which tests are consistently flaky.
– What are the common causes of failure across tests.
– Which tests consistently take a long time to run.
– Using this information we can move away from the ‘re-run’ culture and better support continuous integration goals of having quick, reliable, deterministic tests.