Twitter/X

Unsloth AI says GLM-5.2 can be run locally as a 2-bit quantized model that…

2026-06-18 · 20:57 UTC ·@BrianRoemmele ·0 min read

Brief

Unsloth AI released a locally runnable GLM‑5.2 2‑bit model that they say preserves ~82% accuracy after reducing size from 1.51 TB to 238 GB (‑84%), with GGUF weights and a setup guide available; it reportedly runs on a 256 GB Mac or similar RAM/VRAM systems. Brian Roemmele adds that The Zero‑Human Company has it on hundreds of machines and touts it as the strongest open model, stressing no special "gun license" is required.

Why it matters

Unsloth AI says GLM-5.2 can be run locally as a 2-bit quantized model that retains ~82% accuracy after shrinking from 1.51 TB to 238 GB (‑84% size reduction).

Key details

  • The 2-bit GLM-5.2 reportedly runs on a 256 GB Mac or comparable RAM/VRAM setups, with GGUF and a guide posted (Hugging Face and unsloth.ai links).
  • Author Brian Roemmele claims The Zero‑Human Company has the model on '100s of computers' and emphasizes 'NO “GUN LICENSE” NEEDED,' calling GLM‑5.2 the strongest open model to date.
Source evidence

BOOM!

The amazing @UnslothAI does it again!

Mythos Class AI On YOUR LOCAL COMPUTER!

NO “GUN LICENSE” NEEDED.

We have it on 100s of computers at The Zero-Human Company.

More soon!

Unsloth AI (@UnslothAI)

GLM-5.2 can now be run locally!🔥

The 2-bit model retains ~82% accuracy after we shrunk it from 1.51TB to 238GB (-84% size).

Run on a 256GB Mac or RAM/VRAM setups.

GLM-5.2 is the strongest open model to date.

Guide: unsloth.ai/docs/models/glm-5…
GGUF: huggingface.co/unsloth/GLM-5…

— https://nitter.net/UnslothAI/status/2067588262156501497#m