The latest platform addition empowers development managers to fix flaky testing, complementing the platform’s overall vision of Continuous Quality for developers.
Launchable, the intelligence platform layer for all software testing, announced their latest addition to the platform, Flaky Tests Insights (beta). Access to these insights will help development teams strengthen CICD pipeline observability by quickly identifying and pinpointing the top flaky tests in a test suite to prioritize fixing the appropriate tests.
Flaky tests are a pervasive problem for development teams. Unreliable tests are an issue for development velocity, where development teams waste time diagnosing test failures to separate the real from false failures.
Recommended ITech News: Syniti Acquires Leading Data Matching Technology Company 360Science
Today there are no tools that flag flaky tests for development teams. The knowledge that some tests are flaky builds by observing false failures in multiple runs. The bigger the test suite, the harder it becomes to keep track of all the flakes. Nobody has a comprehensive picture of flakes across test suites.
Data driven insights on flakes can help teams prioritize their efforts on fixing the costliest issues first.
“Unreliable of flaky tests are a systemic problem in eroding development velocity, said Alastair Wilkes, Director of Product Management at Launchable. “It has been amongst the top 3 problems that development teams have consistently asked us to solve. The Launchable Intelligence Platform can easily identify and prioritize these tests helping teams to concentrate fixing the most impactful problems.”
Recommended ITech News: DataRobot Propels Intelligent Business Forward with Launch of “DataRobot AI Cloud”
Launchable now analyzes test runs to identify flaky tests in the suite so customers can fix them. To do this, Launchable assigns each test a flakiness score from 0-1, with higher scores indicating higher likelihood of flakiness, giving developers a clearer picture of which flaky tests to tackle first. The dashboard can be used as an information radiator for the development team to go fix issues that are impacting them the most.
“At any point in time, only a small number of tests are flaky but over a period of time decay sets into the tests,” said D.T., Engineering Director. “The problem is that people continue to live with inefficiencies. A tool that flags tests as flakes would go a long way in helping us prioritize and remove the inefficiencies.”
Recommended ITech News: Alation Launches New Data Governance Product to Deliver Autonomous Governance at Scale
