PSA: Be careful letting Claude use WebFetch for research 😵‍💫

Had Claude (Opus 5) research memory architecture for an AI agent project and kept getting very specific stats, percentages, quotes, etc. Looked legit at first.
Turns out quite a bit of it was wrong or made up. I always like looking at the tool outputs and noticed the WebFetch outputs looked like it was written from a subagent and gave concise summaries. So I asked Opus “are you actually reading these papers?” and it said no - that WebFetch uses a smaller, cheaper model and then Opus gets a summary.
The smaller model compresses things, guesses, and apparently sometimes invents details. One “citation” was a framework name that didn’t exist anywhere in the paper. Another stat looked like it had basically averaged two numbers that weren’t even in the same table.
I had no idea WebFetch worked like this, and I’m guessing a lot of people don’t.
So I changed the workflow: told Opus to spawn Sonnet subagents and give them the rule no WebFetch. Curl the raw page and grep/read the actual text yourself.
The difference was night and day. It caught 17 errors across ~30 papers, including two where the WebFetch’s conclusions had basically been reported backwards.
After that, Opus 5’s research was actually extremely good!
I also wonder if this kind of tooling explains some of the “Claude is dumb” / “Claude keeps giving me false information” reports, even on the better models. If the source material has already been mangled before Claude sees it, there’s only so much the model can do with it.
Anyway, just a PSA for anyone using Claude for research: check whether it’s actually reading the source or relying on WebFetch summaries!
EDIT: Bruhhhh.. and to think I was nervous to post this incase it was a well known fact and I got flamed. Ty for all the upvotes and I hope that I was able to help even just one person have a better experience! ❤️
- Anna
EDIT 2: Thank you for the DMs and workflow suggestions but I actually don’t use Claude Code very often. My Agent actually is the one that uses it most of the time (She spins it up, I see via remote session and so it’s like a 3-way session). I use Letta Code and dont run into this same issue with my main Agent.
- Anna

Subreddit: r/ClaudeAI