Twitter/X

NVIDIA released Nemotron-3.5-ASR on 2026-06-23

2026-06-23 · 21:48 UTC ·@DataChaz ·1 min read

Brief

Nemotron-3.5-ASR is a 0.6B-parameter open-source speech recognition model released by NVIDIA on 2026-06-23 that targets real-time streaming and local/offline pipelines. It supports 40+ languages, uses a cache-aware architecture to cut redundant computation, offers configurable latency down to 80ms, produces punctuated/capitalized outputs, and claims ~17× concurrency gain vs prior 1.1B buffered models while running on CPUs or L40S GPUs.

Why it matters

NVIDIA released Nemotron-3.5-ASR on 2026-06-23: a 0.6B-parameter, open-source real-time streaming speech recognition model that supports 40+ languages and emits punctuated, capitalized text automatically.

Key details

  • Nemotron-3.5-ASR uses a cache-aware architecture to eliminate redundant audio computation, provides configurable latency down to 80ms chunk sizes, and at its lowest latency handles ~17× more concurrent streams than previous 1.1B buffered models.
  • Designed for local/offline voice pipelines and agent systems, the model runs efficiently on CPUs and L40S GPUs (avoiding mandatory H100s) and is 100% free with repo and weights available.
Source evidence

🚨 @NVIDIA just quietly dropped an incredibly impressive speech recognition model that completely changes the math for local voice pipelines.

Nemotron-3.5-ASR is a 0.6B parameter, open-source model built specifically for real-time streaming.

What makes it so good:
→ 40+ supported languages
→ Cache-aware architecture (eliminates redundant audio computation)
→ Configurable latency (down to 80ms chunk sizes)
→ Emits beautifully punctuated, capitalized text automatically

Because it’s so remarkably lightweight, it doesn't force you into a massive H100 dependency.

It scales brilliantly on CPUs or widely available L40S GPUs.

At its lowest latency setting, it handles ~17x more concurrent streams than previous 1.1B buffered models.

HUGE win for devs building agent pipelines:

you now have local, offline speech processing that is lighter, noticeably faster, and keeps data safely within your own security boundaries.

100% FREE and open-source.

Repo and weights in 🧵↓

Video