ArXiv

UniWorld-Design: From Pixel Generation to Layer-Native Design

2026-08-04 · 17:39 UTC ·Zongjian Li, Zhiyuan Yan, Chenxu Bai... ·1 min read
Authors
Zongjian Li, Zhiyuan Yan, Chenxu Bai...
Categories
cs.CV
arXiv
https://arxiv.org/abs/2608.03971v1
PDF
https://arxiv.org/pdf/2608.03971v1

Brief

UniWorld-Design introduces a layer-native framework that generates and edits semantic RGBA layers instead of raw pixels, implemented via two models: T2RGBA (text → RGBA assets) and I2L (image → ordered semantic RGBA layers with recursive and targeted decomposition). Evaluations report a 37% per-layer RGB L1 reduction and 34% Alpha Soft IoU gain on Crello versus Qwen-Image-Layered; T2RGBA leads on CLIP Score against LayerDiffuse and OmniAlpha. Summary based on the paper abstract; full text was not reviewed.

Why it matters

UniWorld-Design reframes generation around semantic RGBA layers (the atomic units) and provides two models: Text-to-RGBA (T2RGBA) to synthesize standalone RGBA assets from text, and Image-to-Layer (I2L) to decompose finished images into ordered, editable semantic RGBA layers with instruction-addressable decomposition.

Key details

  • On the Crello benchmark, I2L reduces per-layer RGB L1 error by 37% and achieves a 34% relative improvement in Alpha Soft IoU compared to Qwen-Image-Layered.
  • T2RGBA attains the highest CLIP Score in the authors' comparisons, outperforming prior layer-oriented methods LayerDiffuse and OmniAlpha.
Source evidence

Abstract

We introduce UniWorld-Design, a framework that redefines image generation from flat pixel synthesis to structured visual composition, with semantic RGBA layers as the atomic units of generation, understanding, and editing. Our key insight is that pixels define how an image is rendered, whereas layers define how an image is created, understood, and edited. Just as human designers create and manipulate visual content through layers rather than raw pixels, UniWorld-Design equips multimodal generative models with a layer-native design space. UniWorld-Design comprises two models. The Text-to-RGBA (T2RGBA) model generates standalone RGBA assets directly from text. The Image-to-Layer (I2L) model conditions on a finished image, a global instruction and per-layer prompts, and jointly produces ordered, complete semantic RGBA layers. Its instruction interface supports top-level decomposition, recursive decomposition and targeted extraction, making layering an instruction-addressable operation for agentic editing. Because I2L learns complete semantic objects rather than visible-pixel partitions, its layers stay usable when moved or removed. On the Crello benchmark, I2L reduces per-layer RGB L1 error by 37% and achieves a 34% relative improvement in Alpha Soft IoU over Qwen-Image-Layered. Separately, T2RGBA achieves the highest CLIP Score, outperforming LayerDiffuse and OmniAlpha.

Comment: Project page: https://rabbitvis.rabbitpre.com/blog