I've been working with Prime Radiant building a new tool for running small eval suites against models, harnesses, and prompts - it's called "smevals", you can try it with "uvx smevals docs", and I wrote about it here: primeradiant.com/blog/2026/s…
@simonw (Simon Willison) collaborated with Prime Radiant to build a tool named…
Brief
smevals is a lightweight evaluation tool created by Simon Willison in collaboration with Prime Radiant to run small eval suites against models, harnesses, and prompts. The tool is runnable via the CLI command "uvx smevals docs," and Simon posted a detailed blog write-up at primeradiant.com/blog/2026/ on 2026-07-31.
Why it matters
@simonw (Simon Willison) collaborated with Prime Radiant to build a tool named "smevals" for running small evaluation suites against models, harnesses, and prompts.
Key details
- You can try smevals with the command "uvx smevals docs"; Simon published a write-up at primeradiant.com/blog/2026/ on 2026-07-31.