This is the kind of thing needed to push local AI. If my local models can be configured to go do reading, exploring etc.. tasks that don’t require giga brains.
Manually switching to min max providers is annoying there’s no good ux around it.
Excited to test this next week
Factory (@FactoryAI)
Reliability is built into @droid. Factory Router has auto-failover across model providers, so your sessions keep running even when one of the providers goes down.
We also provide dedicated compute capacity for enterprises, and we reserve a guaranteed TPM (token per minute) allocation.
We believe that diversifying LLMs in your agent stack is the future, and the way to achieve the highest reliability in production.
Video
— https://nitter.net/FactoryAI/status/2062625418335932736#m