Back to Search Start Over

Learning to disentangle latent physical factors of deformable faces.

Authors :
Ha, Inwoo
Chang, Hyun Sung
Son, Minjung
Yoon, Sung-eui
Source :
Visual Computer. Aug2023, Vol. 39 Issue 8, p3481-3494. 14p.
Publication Year :
2023

Abstract

We proposed a monocular image disentanglement framework based on a compositional model. Our model disentangles the input image into its constituent components of albedo, depth, deformation, pose, and illumination. Instead of relying on any handcrafted priors, we trained our deep neural network to understand the physical meaning of each element by mimicking real-world operations, allowing it to reconstruct images in a self-supervised manner. Our model, trained on multi-frame images of each subject, demonstrates a better understanding of the objects without requiring any supervision or strong model assumptions. We utilized a deformation-free canonical space to align multi-frame images in the same space. This approach enables the understanding of information from multi-frame images in the same space. Our experiments showed that our approach accurately disentangled the physical elements of deformable faces from images with wide variations found in the wild. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
01782789
Volume :
39
Issue :
8
Database :
Academic Search Index
Journal :
Visual Computer
Publication Type :
Academic Journal
Accession number :
170026901
Full Text :
https://doi.org/10.1007/s00371-023-02948-1