You can now run Inkling-Small, a new 276B model by Thinking Machines.
Inkling-Small is the strongest open model for its size and runs local on 128GB RAM.
Apache-2.0 Licensed, it has image, audio + 1M context support.
Guide: unsloth.ai/docs/models/inkli…
GGUF: huggingface.co/unsloth/Inkli…
Thinking Machines (@thinkymachines)
Today, we are releasing Inkling-Small.
Inkling-Small achieves comparable performance to Inkling at a quarter of its size. It features 276B total parameters, 12B active. We are making the full weights available.
thinkingmachines.ai/news/ink…
Fine-tune it on Tinker today, or chat with it in text, image, and audio on Tinker Playground.
Link
Introducing Inkling-Small
An open-weights model that matches Inkling at a quarter of the size: multimodal, Mixture-of-Experts, with controllable reasoning effort. Fine-tune it on Tinker.
thinkingmachines.ai
— https://nitter.net/thinkymachines/status/2082885869426631032#m