Back to Search Start Over

Detailed Avatar Recovery From Single Image.

Authors :
Zhu, Hao
Zuo, Xinxin
Yang, Haotian
Wang, Sen
Cao, Xun
Yang, Ruigang
Source :
IEEE Transactions on Pattern Analysis & Machine Intelligence. Nov2022, Vol. 44 Issue 11, p7363-7379. 17p.
Publication Year :
2022

Abstract

This paper presents a novel framework to recover detailed avatar from a single image. It is a challenging task due to factors such as variations in human shapes, body poses, texture, and viewpoints. Prior methods typically attempt to recover the human body shape using a parametric-based template that lacks the surface details. As such resulting body shape appears to be without clothing. In this paper, we propose a novel learning-based framework that combines the robustness of the parametric model with the flexibility of free-form 3D deformation. We use the deep neural networks to refine the 3D shape in a Hierarchical Mesh Deformation (HMD) framework, utilizing the constraints from body joints, silhouettes, and per-pixel shading information. Our method can restore detailed human body shapes with complete textures beyond skinned models. Experiments demonstrate that our method has outperformed previous state-of-the-art approaches, achieving better accuracy in terms of both 2D IoU number and 3D metric distance. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
01628828
Volume :
44
Issue :
11
Database :
Academic Search Index
Journal :
IEEE Transactions on Pattern Analysis & Machine Intelligence
Publication Type :
Academic Journal
Accession number :
160650587
Full Text :
https://doi.org/10.1109/TPAMI.2021.3102128