PaintBench, introduced by @itskaixu on 2026-06-02, is a benchmark of visual editing operations with a single correct outcome (for example, moving a circle exactly 50 pixels). It reveals that state-of-the-art image-editing models struggle with precise edits: @NanoBanana 2—currently the best tested—achieves just a 17.1% success rate, with a video demonstrating typical failures.
Author @itskaixu launched PaintBench, a foundational evaluation suite for image-editing operations that have a single correct answer (e.g., move a circle exactly 50 pixels).
Image editing models can put you on the Moon, but can they precisely move a circle right by 50 pixels? 📐
Introducing 🎨PaintBench: a foundational eval of visual editing operations with only one right answer.
The highest-performing model (@NanoBanana 2) reaches only 17.1%.
Video