The team @figbrains, collaborating with @manifoldrg and announced by @HarshSikka on 2026-06-22, demonstrates that three top computer-use/browser models are brittle: simple perturbations like zoom and color changes cause failures. They release a new SoTA Evaluation Dataset for Browser-use models and an interactive data sandbox to help researchers reproduce, probe, and improve model robustness against commonplace UI variations.
The team @figbrains, with collaborators @manifoldrg and author @HarshSikka, evaluated three leading computer-use/browser models and found all three failed under simple perturbations such as changing zoom level or color schemes.
The team @figbrains, along with our friends @manifoldrg, took three of the best computer-use models and, surprisingly, broke all of them with very simple perturbations like changing zoom or colors.
Read on to understand our research, including a new SoTA Evaluation Dataset for Browser-use models + a new kind of interactive data sandbox!