We compared 1-bit Kimi K3 to Claude Opus 5 and GPT 5.6.
We gave 4 models the same prompt:
Create a glass aquarium whose side panel develops a visible crack and then bursts.
1-bit Kimi K3 GGUF ran locally on 4x B200s at 36 tok/s.
GitHub repo: github.com/unslothai/unsloth
Video
Unsloth AI (@UnslothAI)
Kimi K3 can now be run locally! ✨
The 1-bit model retains ~78.9% accuracy after we shrunk it from 1.56TB to 594GB (-62% size).
Run on a Mac Studio + 128GB RAM device.
Kimi K3 is the strongest open model to date.
Guide: unsloth.ai/docs/models/kimi-…
GGUF: huggingface.co/unsloth/Kimi-…
— https://nitter.net/UnslothAI/status/2082463988953367031#m