Twitter/X

Unsloth for AMD enables training and running 500+ models on AMD GPUs (Radeon…

2026-07-21 · 00:29 UTC ·@DynamicWebPaige ·1 min read

Brief

Unsloth AI's "Unsloth for AMD" (announced July 21, 2026) delivers AMD-optimized tooling that claims to let users train and run 500+ LLMs — including Qwen and Google Gemma 4 — on consumer and data-center AMD GPUs with as little as 3 GB VRAM, using custom Triton kernels for up to 2× speed and 70% VRAM reduction; it’s open-source with ROCm, GGUF/Safetensors, GitHub and docs links.

Why it matters

Unsloth for AMD enables training and running 500+ models on AMD GPUs (Radeon, Instinct, Ryzen), supports Windows/WSL/Linux, and claims you can train Qwen and Google Gemma 4 on as little as 3 GB VRAM.

Key details

  • Performance claims: up to 2× faster with 70% less VRAM and no accuracy loss using custom Triton kernels and math algorithms; also offers optimized ROCm builds for GGUF and Safetensors inference.
  • Unsloth is an open-source local UI with tool-call healing, code execution, secure web search, remote APIs and HTTPS deployment; it can connect local models to Claude Code and Codex agents and run Kimi, GLM, DeepSeek, Qwen3.6, and Gemma 4 (GitHub and docs provided).
Source evidence

You can now fine-tune models on your personal laptops, and run the latest @GoogleGemma 4 models with as little as 3GB VRAM (🤯).

👇Stellar work, as always, from the @UnslothAI team!

Unsloth AI (@UnslothAI)

Introducing Unsloth for AMD 🚀
You can now train & run LLMs on your AMD hardware

• We collaborated with AMD to enable you to train & run 500+ models on AMD GPUs
• Works on Windows, WSL, Linux
• Train Qwen, Gemma on 3GB VRAM

GitHub: github.com/unslothai/unsloth

Works on Radeon, Instinct, Ryzen and data center GPUs with up to 2× faster with 70% less VRAM and no accuracy loss via our custom Triton kernels and math algorithms. We also support optimized ROCm builds for GGUF & Safetensors inference.

Unsloth is an open-source local UI for faster LLM training and inference, with tool-call healing, code execution, secure web search, remote APIs, and HTTPS deployment. Connect local models to Claude Code, Codex agents and run the latest Kimi, GLM, DeepSeek, Qwen3.6, and Gemma 4 models.

🔗Blog + Guide: unsloth.ai/docs/basics/amd

— https://nitter.net/UnslothAI/status/2079207457788952944#m