Multilingual Reasoning Cascades Need More Context

2026-06-25 · 17:26 UTC ·Arnav Mazumder, Dengjia Zhang, Shuyue Stella Li... ·1 min read

Brief

The authors introduce a context-aware translation cascade that appends the original question, its English translation, and the English reasoning trace to the final translation step. Evaluated on nine multilingual benchmarks with three backbone models across 285 languages, the training-free intervention markedly improves open-ended generation. Ablations attribute most gains to preserving the original-language question and argue for rethinking cascade information flow.

Why it matters

A simple, training-free context-aware cascade—giving the final translation module the original question, the English-translated question, and the English reasoning trace—yields strong gains for open-ended generation across nine multilingual benchmarks, three backbone models, and 285 high-/mid-/low-resource languages (ArXiv, 2026-06-25).

Key details

Ablations show the original-language question supplies most of the helpful context; preserving the original user question until the end of the pipeline is the primary actionable strategy to mitigate error propagation.

The paper diagnoses translation cascades as structurally lossy—stages discard cues for cultural grounding, register, and disambiguation—motivating redesign of information flow in multilingual reasoning systems.

Abstract

Translation cascades for reasoning translate the query from another language to English, reason in English, and translate the answer back to the original language. This is a competitive approach to multilingual reasoning, but structurally lossy, since each stage discards information later stages may need, including cues for cultural grounding, register, and disambiguation. We examine the benefits of a simple and training-free intervention: a context-aware translation cascade, which additionally provides the original question, the English translated question, and the reasoning trace to the context of the final translation module. We evaluate gains across nine multilingual benchmarks including various task types, three backbone models, and 285 high-, mid-, and low-resource languages, and demonstrate strong gains for open-ended generation across models and resource regimes. We show that the original language question carries most of the beneficial context. Our study emphasizes the need to better design information flow in machine translation cascades for mitigating error propagation, and provides a simple and actionable default strategy: preserve the original user question until the end of the pipeline.