You don’t need to run every damn task through a flagship model.
The ones who setup local LLM’s on their own hardware are going to see outsized gains with the correct task routing.
If you want to get see what the process looks like to get a model up and running on your laptop - read this.
It’s not as hard as you might think.
Tom (@tomcrawshaw01)
Article
How To Set Up A Local LLM On Your Laptop For Unlimited Free Usage
It takes two lines of commands and a few minutes of your time to get up and running and testing on your laptop.
Every model I rent comes with a meter attached. Claude has a usage cap, the API bills
— https://nitter.net/tomcrawshaw01/status/2084624403539906976#m