ArXiv

Simple Domain Generalization for Strong Pixel-Level Image Tampering Detection in Modern VLMs

Authors
Yi Tang, Xinyi Shang, Jiacheng Cui...
Categories
cs.CV, cs.AI
arXiv
https://arxiv.org/abs/2607.18230v1
PDF
https://arxiv.org/pdf/2607.18230v1

Brief

Domain generalization for pixel-level image tampering detection in modern VLMs is addressed by a simple framework combining balanced minibatch sampling and a late-injection fine-tuning stage to avoid biased optimization and adapt to new VLM distributions using limited data. The method outperforms PIXAR by 26.1% gIoU and 26.8% cIoU on OOD VLMs (GPT-Images-2.0, Gemini-3.1, FLUX.2, Seedream 4.5); code is released on GitHub.

Why it matters

Proposes two practical training strategies for domain-generalized pixel-level tampering detection: balanced minibatch sampling (each minibatch contains both tampered and real images to avoid biased optimization and training collapse) and late-injection (train on large-scale base data to convergence, then expose a small supporting set from new VLMs).

Key details

  • Reports large out-of-distribution gains over prior SOTA PIXAR: +26.1% average gIoU and +26.8% average cIoU across OOD VLMs GPT-Images-2.0, Gemini-3.1, FLUX.2, and Seedream 4.5.
  • Targets modern VLM-generated manipulations (e.g., ChatGPT, Gemini, Qwen-Image) and provides code at https://github.com/VILA-Lab/PIXAR-DG.
Source evidence

Abstract

Modern vision-language models (VLMs) have significantly improved image generation and editing capabilities, making pixel-level image tampering detection increasingly important yet challenging under cross-model and out-of-distribution shifts. This work studies domain generalization for pixel-level image tampering detection in modern VLMs like ChatGPT, Gemini, Qwen-Image, etc., aiming to learn tampering localization models that remain robust across diverse VLM-generated manipulation distributions. We propose a simple yet effective domain-generalized training framework built on two practical strategies. First, we introduce a balanced minibatch sampling scheme that strategically samples tampered and real images in each minibatch, preventing biased optimization toward either manipulated artifacts or clean-image priors and avoiding training collapse, ensuring that each optimization step receives proper sampled gradient signals. Second, we adopt a simple late-injection strategy, where the detector is first trained on large-scale base data until stable convergence, and then exposed to a small amount of newly selected supporting data from emerging VLM distributions, improving adaptability without overfitting to limited new domains. Together, these components provide a simple yet strong recipe for improving pixel-level tampering localization and OOD robustness across modern VLMs. Despite the conceptual simplicity, our framework outperforms the prior state-of-the-art PIXAR by a large margin of 26.1% and 26.8% relative improvement in average gIoU and cIoU, respectively, across OOD VLMs of GPT-Images-2.0, Gemini-3.1, FLUX.2, and Seedream 4.5. Our code is available at https://github.com/VILA-Lab/PIXAR-DG

Comment: Our code is available at https://github.com/VILA-Lab/PIXAR-DG