The AI Behavioral Observatory, released open source by @emollick's lab on 2026-07-29, is a research tool designed to run statistically valid experiments measuring how model outputs change across prompt variations. The team reports internal use in their studies and shares the project (gail.wharton.upenn.edu/resea…) as a resource for other researchers to replicate or build on prompt‑sensitivity experiments.
Author @emollick announced (2026-07-29) their lab released the AI Behavioral Observatory as open‑source software for running statistically valid tests on how AI behavior changes under different prompt types.
Our lab just released our AI Behavioral Observatory open source. It lets you run statistically valid tests on how AI behavior changes under various types of prompts. We have been using it for our own studies & I think it could help others do similar work. gail.wharton.upenn.edu/resea…
Link
From building an AI research tool to prompting the research itself
gail.wharton.upenn.edu