ArXiv

OpenThoughts-Agent: Data Recipes for Agentic Models

Authors
Negin Raoof, Richard Zhuang, Marianna Nezhurina...
Categories
cs.AI
arXiv
https://arxiv.org/abs/2606.24855v1
PDF
https://arxiv.org/pdf/2606.24855v1

Brief

OpenThoughts-Agent presents an open, experimentally validated pipeline for curating training data for broadly capable agentic LMs. The team ran 100+ ablations, assembled a 100K-example dataset, and fine-tuned Qwen3-32B to 44.8% average accuracy on seven agentic benchmarks — outperforming Nemotron-Terminal-32B by 3.9 points. Data, models, and code are publicly released; summary is based on the abstract.

Why it matters

OpenThoughts-Agent (OT-Agent) introduces a fully open data curation pipeline for training agentic models and reports more than 100 controlled ablation experiments to analyze pipeline stages and task-source diversity.

Key details

  • Fine-tuning Qwen3-32B on a 100K-example OT-Agent training set yields 44.8% average accuracy across seven agentic benchmarks — a 3.9 percentage-point gain over the prior best open-data model Nemotron-Terminal-32B (40.9%).
  • The OT-Agent dataset exhibits strong scaling, outperforming alternative open datasets at every training set size in compute-controlled comparisons; authors publicly released training sets, the pipeline, experimental data, and models at openthoughts.ai (arXiv preprint 2026-06-23).
Source evidence

Abstract

Agentic language models dramatically expand the applications of AI yet little is publicly known about how to curate training data for broadly capable agents. Existing open efforts such as SWE-Smith, SERA, and Nemotron-Terminal typically target a single benchmark, leaving open the question of how to train models that generalize across diverse agentic tasks. The OpenThoughts-Agent (OT-Agent) project addresses this gap with a fully open data curation pipeline for training agentic models. We conduct more than 100 controlled ablation experiments to systematically investigate each stage of the pipeline, yielding insights on the importance of task sources and diversity. We then assemble a training set of 100K examples from our pipeline and fine-tune Qwen3-32B on this dataset, which yields an average accuracy of 44.8% across seven agentic benchmarks and a 3.9 percentage point improvement over the strongest existing open data agentic model (Nemotron-Terminal-32B, 40.9%). Moreover, our training data exhibits strong scaling properties, outperforming alternative open datasets at every training set size in compute-controlled comparisons. We publicly release our training sets, data pipeline, experimental data, and models at openthoughts.ai to support future open research on agentic model training.