Twitter/X

Harvey and EngramLab open-sourced a 100M+ token synthetic law firm dataset called…

2026-08-07 · 17:22 UTC ·@harvey ·1 min read

Brief

Harvey and EngramLab released a 100M+ token synthetic law firm, Calderwood & Harkness (C&H), containing ~10,000 files from 250+ synthetic matters across 46 clients to benchmark agents' ability to search and apply a firm's historical work and processes. The dataset is part of Harvey's LAB expansion and is framed as a first step toward agents that mirror partner/associate institutional knowledge, with detailed writeups by Julio Pereyra and Niko Grupen.

Why it matters

Harvey and EngramLab open-sourced a 100M+ token synthetic law firm dataset called Calderwood & Harkness (C&H) on 2026-08-07, intended for agent evaluation.

Key details

  • The dataset includes work product from 250+ synthetic matters, spans 46 synthetic clients, and comprises roughly 10,000 files.
  • Purpose: evaluate agents' ability to search and internalize a firm's past practice—aiming to replicate knowledge a tenured associate or partner would have; deep dive by @ItsJulioPereyra and @nikogrupen.
Cleaned source text

We're open sourcing a 100M+ token synthetic law firm we built with @EngramLab.

The firm contains work product from 250+ synthetic matters across 46 clients, spanning ~10k files.

We built this environment to evaluate an agents' ability to search and understand a firm's past practice to inform present work - the same knowledge that a tenured associate or partner would have.

It's our first step towards building agents that deeply understand a firm's work and processes. More to come soon

Deep dive by @ItsJulioPereyra and @nikogrupen:

Julio Pereyra (@ItsJulioPereyra)

Article

LAB: Law Firm Knowledge

We are open-sourcing our next LAB expansion: a synthetic law firm, Calderwood & Harkness (“C&H” or “the firm”). Built in collaboration with @engramlab, the firm contains work product from more than

— https://nitter.net/ItsJulioPereyra/status/2085772997944803682#m