Test trend analysis: towards robust, reliable and timely tests

In this talk you will get ideas about how you can instrument test result information to provide actionable data, paving the way for more robust, reliable and timely test results.

By capturing this information over time, and when combined with visualization tools, we can answer different questions than with existing solutions (Allure/CI tool build history). Some examples of these are:

– Which tests are consistently flaky.
– What are the common causes of failure across tests.
– Which tests consistently take a long time to run.
– Using this information we can move away from the ‘re-run’ culture and better support continuous integration goals of having quick, reliable, deterministic tests.

Hugh McCamphill

Principal Software Engineer in Test at Liberty IT, Ireland

Hugh works as a Principal Software Engineer in Test with Liberty IT in Belfast. He has over ten years of experience, latterly focused on helping teams realize their testing and automation capabilities. He has been the organizer of the Belfast Selenium Meetup since 2013.