I'll be sharing a first look at local dot ai with @huggingface on Tuesday.
We benchmarked every model, quantization, harness, MTP setting, EVERYTHING, on every local device - and we're opening it up for free on local dot ai.
Every single data point on local dot ai has 700+ tasks behind it. We measure what an end user will actually experience - intelligence and end-to-end time to complete tasks - to answer questions like:
- What device is the best value for Local AI?
- What model should I run on my MacBook or DGX Spark?
- How do I cluster devices to boost performance / run larger models?
So many insights to cover. Be there Tuesday.
Hugging Face (@huggingface)
Join us this Tuesday to learn more on Local AI, from software to hardware 🤗
We'll be joined by @TheAhmadOsman & @MikeBradleyAI covering hardware setups & local inference with live demo, and @alexocheema & @0xSero on picking model for your hardware, model compression and REAPs 🔥
Set your reminders to not miss out! 🔔
— https://nitter.net/huggingface/status/2078878406335201738#m