The types of hard problems @EngramLab works on ft. co-founder @dan_biderman:
"Clients do financing, mergers, acquisitions and things like take loans and do deals. And there's many queries that agents might run into which are these kinds of ambient, hard questions that are not easily searchable with RAG.
For example, if you want to ask, which M&A deals haven't we completed this year? To actually solve this problem, you have to go client matter by client matter [and] read all the files. You can't read in any place that it was not completed."
Video
Harvey (@harvey)
We're open sourcing a 100M+ token synthetic law firm we built with @EngramLab.
The firm contains work product from 250+ synthetic matters across 46 clients, spanning ~10k files.
We built this environment to evaluate an agents' ability to search and understand a firm's past practice to inform present work - the same knowledge that a tenured associate or partner would have.
It's our first step towards building agents that deeply understand a firm's work and processes. More to come soon
Deep dive by @ItsJulioPereyra and @nikogrupen:
— https://nitter.net/harvey/status/2085778520220049891#m