Author : Gal Vered

As Co-founder and Head of Product at Checksum.ai, we're driving AI-powered test automation, enabling faster, bug-free software. Our team has forged a key partnership with Google Cloud, expanding its scalable testing solutions. This work supports the company’s goal to improve software quality. We aim to do this through efficiency, innovation, and advanced AI technology. Web agent benchmarks are broken. Frameworks like Browserbase’s Stagehand evals and agent-evals have fundamental gaps that make them poor predictors of real-world automation success. Here’s the uncomfortable truth: current benchmarks tell us AI isn’t ready to automate the web. But that’s not the whole story.