Applitools, provider of the next generation test automation platform powered by Visual AI, recently analyzed millions of tests from customers and found that its AI-powered automated maintenance automatically resolved two additional test steps for every step that was manually reviewed, improving engineering productivity more than three-fold.
The research team also ran a simulation to compare the test results of Applitools’ Visual AI versus other tools that use pixel matching and less mature AI algorithms. The comparison ran millions of tests against Applitools versus other tools and found that Applitools reduced the number of false positives by 3x with the average test run. These false positives that are flagged by less sophisticated algorithms make it all but impossible to scale to the pace of modern CI/CD and run across multiple environments. Engineers spend countless hours analyzing false bugs caused by algorithms that are not accurate or mature enough.
CIO INFLUENCE:Â Snow Software Launches New Capabilities to Help ITAM Teams Get Control of Costs in the Cloud
Applitools’ AI-powered test validation and maintenance capabilities support the adoption of automated testing strategies that take the burden off of testing teams who would otherwise spend hours reviewing and updating hundreds or thousands of test results.
“As engineering teams mature and scale their release and testing strategies, they face new challenges to keep pace with CI/CD environments,” said Moshe Milman, co-founder and COO of Applitools. “Applitools’ Visual AI technology is the only solution in the market that offers AI-powered auto-analysis and auto-maintenance of tests and the test accuracy that is required to run at a rapid rate. Testing teams can now quickly and accurately assess test results across different environments and identify where bugs are happening so that they can improve their overall testing strategy and make a direct impact on the bottom line.”
Applitools has revolutionized automated testing by using artificial intelligence and machine learning technology to visually capture, analyze and verify full pages of apps and websites with more accuracy than the human eye and at the pace of automation. As user experience (UX) validation becomes a must in organizations undergoing digital transformation, there are three components of testing to be considered: Validation, Analysis and Maintenance. Only the use of Visual AI enables automating these aspects at scale
CIO INFLUENCE:Â Elation Health and Ribbon Health Partner to Deliver Exceptional Referral Management
Applitools Eyes can validate thousands of full-page screens in just minutes, intelligently testing dynamic content like ads or app dashboards. As test validation becomes better and more ubiquitous at comparing interfaces, it yields more test results that testing and engineering teams must analyze, group and maintain. Using Visual AI, Applitools automatically analyzes these comparisons and groups them together based on environments, design components, browsers and more. Once grouped and reviewed, auto-maintenance also takes care of updating the new baselines – saving hours of repeat work in every release cycle.
According to Applitools’Â 2022 State of UI/UX Report, 60% of Applitools customers are deploying changes to production daily, while only 37% of non-customers are deploying daily. This increase in release velocity is directly attributable to the significant increase in test coverage that Applitools offers. Applitools customers see more than 75% test coverage on average compared to non-customers that see less than 50% test coverage on average. With Applitools, test suite execution takes less than 15-20 minutes on average which is 4x faster than non-customers using traditional methods.
CIO INFLUENCE:Â GDIT Forms 5G and Edge Accelerator Coalition with AWS, Cisco, Dell Technologies, Splunk and T-Mobile
[To share your insights with us, please write to sghosh@martechseries.com]
