The idea for local dot ai was born at Apple Park.
It was built out at NVIDIA HQ using hardware NVIDIA gave us. No strings attached.
It’s an independent benchmarking website for Local AI.
Some of the most common questions Apple/NVIDIA get from customers:
- What AI models can I run locally on my Mac/Spark?
- Should I buy a MacBook or Mac Mini or DGX Spark to run AI locally?
- Can I cluster machines to increase performance and run bigger models?
local dot ai answers all of these questions.
We benchmarked 1,000+ unique setups in the most rigorous way we know, end-to-end with real agent harnesses, to capture the performance you will experience as an end user.
Every hardware.
Every model.
Every quantization.
Every MTP setting.
We mapped it all out into various pareto frontiers, showing the best local AI configurations. All the data, available for free. A resource for everyone.
Comment below for early access. We’re rolling out access gradually to make sure we can scale and provide a great service. Sending out access codes for the second batch in a few hours.