ArXiv

DanceOPD: On-Policy Generative Field Distillation

Authors
Wei Zhou, Xiongwei Zhu, Zelin Xu...
Categories
cs.CV, cs.CL, cs.LG
arXiv
https://arxiv.org/abs/2606.27377v1
PDF
https://arxiv.org/pdf/2606.27377v1

Brief

DanceOPD tackles the conflict between text-to-image, local editing, and global editing by framing each capability as a velocity field in a shared flow-matching state space. The method routes samples to a single capability field, queries a low-noise student-induced state, and trains the student on its own rollouts with a velocity MSE loss. Experiments report improved multi-capability composition and preservation of anchor generation quality, and the method can absorb operator-defined fields such as classifier-free guidance.

Why it matters

DanceOPD (2026-06-25) introduces on-policy generative field distillation for flow-matching models: each sample is routed to one capability-specific velocity field, the student queries a low-noise student-induced state, and training uses a simple velocity MSE objective to learn composition of capabilities.

Key details

  • Capabilities (text-to-image, local editing, global editing) are represented as velocity fields over a shared flow state; the student learns from fields queried on its own rollout states and can absorb operator-defined fields such as classifier-free guidance (CFG), improving multi-capability composition while preserving anchor generation quality.
  • Technical report (39 pages, 13 figures, 9 tables) with experiments on T2I, editing, realism-field absorption, and CFG absorption that demonstrate strengthened target capabilities and practical applicability; project page: https://danceopd.github.io/.
Source evidence

Abstract

Modern image generation demands a single model that unifies diverse capabilities, including text-to-image (T2I), local editing, and global editing. However, these capabilities are rarely naturally aligned and often conflict. For instance, editing tends to degrade T2I performance, while global and local editing interfere with each other. Consequently, effectively composing these capabilities has become a central challenge for image generation model training. To tackle this, we introduce DanceOPD, an on-policy generative field distillation framework for flow-matching models that routes each sample to one capability field, queries one low-noise student-induced state, and trains with a simple velocity MSE objective. With each capability source defined as a velocity field over the shared flow state space, the student learns from fields queried on its own rollout states to compose expert capabilities. This formulation also absorbs operator-defined fields such as classifier-free guidance. Comprehensive experiments on T2I, editing, realism-field absorption, and CFG absorption show that our approach improves multi-capability composition, strengthening target capabilities while preserving anchor generation quality. We believe this work establishes a practical route for generative field distillation in flow-matching models.

Comment: Technical Report; 39 pages, 13 figures, 9 tables; Project Page at https://danceopd.github.io/