ArXiv

ROAD: Reciprocal-Objective Alignment of Discriminative Semantics for 3D Shape Generation

Authors
Xiao Luo, Mingyang Du, Xin Zhou...
Categories
cs.CV
arXiv
https://arxiv.org/abs/2607.28581v1
PDF
https://arxiv.org/pdf/2607.28581v1

Brief

ROAD presents a method to cut the training cost of high-fidelity 3D generation by injecting discriminative 3D foundation-model priors into diffusion transformers. The core is a reciprocal-objective alignment combining semantic condensation and bipartite-matching structural alignment. According to the abstract, ROAD matches Step1X-3D performance using only 1.5% of training data, with the foundation model employed only during training to avoid inference overhead.

Why it matters

ROAD transfers priors from discriminative 3D foundation models into diffusion transformers using a reciprocal-objective alignment: Holistic Semantic Condensing for global semantic coherence and Structural Optimal Alignment (formulated as a bipartite matching problem) to align microscopic geometry.

Key details

  • ROAD attains highly competitive generation compared to the industrial baseline Step1X-3D while training on only 1.5% of the data and using the foundation model strictly for training supervision (no additional inference cost), substantially reducing training compute.
Source evidence

Abstract

High-fidelity 3D generation predominantly relies on scaling model capacity and data, which incurs prohibitive computational costs. This paradigm typically requires learning geometry from scratch and overlooks the rich semantic and structural priors already encapsulated in discriminative 3D foundation models. We contend that leveraging the profound understanding of the 3D world possessed by these discriminative models can significantly reduce generative cost. To this end, we propose ROAD, a framework that reduces the training cost of 3D generation by transferring these rich discriminative priors into diffusion transformers. To address the inherent semantic-structural heterogeneity between generative and discriminative latents, we introduce a reciprocal-objective alignment strategy. This method synergizes Holistic Semantic Condensing to enforce global semantic coherence and Structural Optimal Alignment, which is formulated as a bipartite matching problem to rigorously align microscopic geometric details between disparate latent spaces. The 3D foundation model is only used for training-time supervision of alignment and is not used at inference, incurring no additional inference cost. Compared with the industrial baseline Step1X-3D, the proposed ROAD achieves highly competitive generation performance with only 1.5% of the training data and significantly reduces training costs, effectively reducing the computational overhead of high-fidelity 3D generation. Code is available at https://github.com/H-EmbodVis/ROAD.