Introducing ask-web: Rox’s in-house web search agent.
ask-web sits on the cost-per-accuracy pareto frontier of the hyper-parameter grid when compared to frontier labs and commercial search agent providers.
The agent delivers 91.3% accuracy at 1.03 cents per query on real production prompts.
It has been running in production for more than 6 months with continuous evals.
Inference partners: @togethercompute, @baseten, @modal
Commercial Search vendors benchmarked: @perplexity_ai, @ExaAILabs, @p0.
Frontier Search vendors benchmarked: @OpenAI, @AnthropicAI
Exa, OpenAI and Anthropic excel on accuracy. Parallel and Perplexity are cost-efficient.
Here’s the breakdown: