ArXiv

DiagLoop: A Counterfactual Data Flywheel with Stage-Localized Reinforcement for Diagnostic LLMs

Authors
Jian Zhang, Bingyi Wang, Yizhi Liu
Categories
cs.LG
arXiv
https://arxiv.org/abs/2608.03674v1
PDF
https://arxiv.org/pdf/2608.03674v1

Brief

DiagLoop addresses scarce diagnostic reasoning data by synthesizing counterfactual worlds from codified mechanisms and using an independent hybrid checker to admit valid cases. A student model learns symptom abstraction, causal-chain construction, and root-cause attribution with stage-localized reinforcement and bounded repair. An 8B model trained only on synthesized scenarios raises strict path correctness (+11.6 pts industrial, +5.5 pts medical) and outperforms proprietary baselines.

Why it matters

DiagLoop is a counterfactual data flywheel that converts codified physical relations or clinical guidelines into training supervision: a training-only teacher proposes counterfactual worlds, an independent hybrid checker admits only valid worlds, and a student reasons through symptom abstraction, causal-chain construction, and root-cause attribution with stage-localized RL, bounded repair, replay, and preservation.

Key details

  • An 8B model trained only on synthesized scenarios (no case-level expert reasoning annotations) improves strict path correctness by 11.6 percentage points across eight industrial systems and by 5.5 points across ten disease categories.
  • Against a deranged-routing control the model gains 3.9 points (industrial) and 2.3 points (medical); it also exceeds the evaluated proprietary references even when those receive few-shot examples or the specification in context.
Source evidence

Abstract

Causal diagnostic models must explain how conclusions follow from evidence because diagnoses guide repairs and treatments. Yet serious cases are scarce, records rarely contain reasoning paths, and data transfer poorly across configurations, complicating local deployment. We present DiagLoop, a counterfactual data flywheel that converts codified physical relations or clinical guidelines, authored once per mechanism family, into training supervision beyond recorded cases. A training-only teacher proposes counterfactual worlds by varying causes, contexts, and observations, while an independent hybrid checker admits only valid worlds. The student reasons through symptom abstraction, causal-chain construction, and root-cause attribution. Stage-specific criteria identify its earliest failure. For nonterminal failures, a bounded repair probes downstream competence, and the resulting weakness profile guides subsequent data generation. Stage-localized reinforcement learning updates only the model-generated continuation, while replay and preservation reduce forgetting. The same criteria govern admission, attribution, reward, and regeneration through checks separate from the proposer. Using only synthesized scenarios and no case-level expert reasoning annotations, the resulting 8B model improves strict path correctness over the strongest conventional baseline. Gains are 11.6 points across eight industrial systems and 5.5 points across ten disease categories. Gains over a deranged-routing control are 3.9 and 2.3 points, respectively. The model also exceeds the evaluated proprietary references in both domains, even when they receive few-shot examples or the specification in context.

Comment: 9 pages, 2 figures