ArXiv

OASIS: Occlusion-aware Single-image Hand Avatar Reconstruction via 3D Gaussian Splatting

Authors
Zhisheng Han, Shiyao Wu, Jiayan Qiu...
Categories
cs.CV
arXiv
https://arxiv.org/abs/2607.29633v1
PDF
https://arxiv.org/pdf/2607.29633v1

Brief

OASIS presents an occlusion-aware single-image hand-avatar reconstruction pipeline built on 3D Gaussian Splatting. It aligns input pixels to 3D hand geometry into context-adaptive visual-evidence tokens, transfers evidence via visibility-conditioned point–image attention, and models articulation with a Feature-on-Mesh that guides Gaussian deformation. A one-shot adaptation scheme learns a shared prior from multi-identity training data then fits to a target image, yielding better fidelity and efficiency than NeRF-style baselines; paper accepted to ACM Multimedia 2026 and code/project pages are provided.

Why it matters

OASIS (Zhisheng Han et al.; arXiv 2026-07-31; accepted to ACM Multimedia 2026) reconstructs single-image 3D hand avatars using 3D Gaussian Splatting with geometry-aligned visual-evidence tokens and a visibility-conditioned point–image attention to produce occlusion-aware Gaussian features.

Key details

  • OASIS adds a Feature-on-Mesh to guide Gaussian deformation by local surface stretching and uses one-shot adaptation (learns a shared multi-identity prior then fits to a target image); authors report improved visual fidelity and efficiency over NeRF-style baselines and demonstrate downstream use (text-to-avatar, texture editing). Code: https://github.com/ivyyy77/OASIS; project: https://mova-hand.github.io/MOVA/.
Source evidence

Abstract

Single-image 3D hand avatar reconstruction is fundamentally ill-posed and particularly challenging due to limited visual evidence under severe self-occlusion and the complex pose-dependent deformation of highly articulated hands. Existing methods predominantly rely on implicit NeRF-style representations, whose volumetric fitting is computationally expensive and often struggles to preserve fine-grained hand details. In this work, we present OASIS, a tailored 3D Gaussian Splatting framework for single-image hand avatar reconstruction. To faithfully encode sparse image-specific appearance cues in single-view reconstruction, we construct geometry-aligned visual evidence tokens by explicitly aligning input image observations with 3D hand geometry and context-adaptively tokenizing the resulting visual evidence. Since severe self-occlusion makes the reliability of image evidence inherently visibility-dependent, we introduce a visibility-conditioned point-image attention to reliably transfer visual evidence to geometric tokens, yielding occlusion-aware Gaussian features for faithful and robust reconstruction. To further capture non-rigid deformation of articulated hands, we introduce a Feature-on-Mesh representation to enable Gaussian deformation to be guided by local surface stretching. Under this framework, we adopt a one-shot adaptation scheme that learns a shared hand prior from multi-identity training data and then fits it to a target image for target-specific reconstruction. Extensive experiments show that OASIS outperforms existing baselines in both visual fidelity and efficiency across challenging poses and in-the-wild scenarios, and further demonstrates strong versatility in downstream applications such as text-to-avatar generation and texture editing.

Comment: Accepted to ACM Multimedia 2026. Project page: https://mova-hand.github.io/MOVA/. Code repository: https://github.com/ivyyy77/OASIS