1. Transporting Deformations of Face Emotions in the Shape Spaces: A Comparison of Different Approaches
- Author
-
Stanley Durrleman, Franco Milicchio, Luciano Teresi, Valerio Varano, Maxime Louis, Benjamin Charlier, Paolo Piras, Antonio Profico, Università degli Studi di Roma 'La Sapienza' = Sapienza University [Rome], Roma Tre University, Institut du Cerveau et de la Moëlle Epinière = Brain and Spine Institute (ICM), Institut National de la Santé et de la Recherche Médicale (INSERM)-CHU Pitié-Salpêtrière [AP-HP], Sorbonne Université (SU)-Assistance publique - Hôpitaux de Paris (AP-HP) (AP-HP)-Sorbonne Université (SU)-Assistance publique - Hôpitaux de Paris (AP-HP) (AP-HP)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), Gestionnaire, HAL Sorbonne Université 5, Università degli Studi di Roma 'La Sapienza' = Sapienza University [Rome] (UNIROMA), Università degli Studi Roma Tre = Roma Tre University (ROMA TRE), Institut du Cerveau = Paris Brain Institute (ICM), Assistance publique - Hôpitaux de Paris (AP-HP) (AP-HP)-Institut National de la Santé et de la Recherche Médicale (INSERM)-CHU Pitié-Salpêtrière [AP-HP], Assistance publique - Hôpitaux de Paris (AP-HP) (AP-HP)-Sorbonne Université (SU)-Sorbonne Université (SU)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), Piras, P., Varano, V., Louis, M., Profico, A., Durrleman, S., Charlier, B., Milicchio, F., and Teresi, L.
- Subjects
Face emotion ,Statistics and Probability ,Matching (graph theory) ,Deformation cycle ,02 engineering and technology ,Deformation (meteorology) ,03 medical and health sciences ,0202 electrical engineering, electronic engineering, information engineering ,Parallel transport ,[SDV.NEU] Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC] ,Thin plate spline ,030304 developmental biology ,0303 health sciences ,Riemannian manifold ,Face emotions ,Applied Mathematics ,Triangulation (social science) ,Condensed Matter Physics ,Computational anatomy ,Shape analysis ,Modeling and Simulation ,Face (geometry) ,Metric (mathematics) ,020201 artificial intelligence & image processing ,[SDV.NEU]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC] ,Geometry and Topology ,Computer Vision and Pattern Recognition ,Algorithm ,Shape analysis (digital geometry) - Abstract
Studying the changes of shape is a common concern in many scientific fields. We address here two problems: (1) quantifying the deformation between two given shapes and (2) transporting this deformation to morph a third shape. These operations can be done with or without point correspondence, depending on the availability of a surface matching algorithm, and on the type of mathematical procedure adopted. In computer vision, the re-targeting of emotions mapped on faces is a common application. We contrast here four different methods used for transporting the deformation toward a target once it was estimated upon the matching of two shapes. These methods come from very different fields such as computational anatomy, computer vision and biology. We used the large diffeomorphic deformation metric mapping and thin plate spline, in order to estimate deformations in a deformational trajectory of a human face experiencing different emotions. Then we use naive transport (NT), linear shift (LS), direct transport (DT) and fanning scheme (FS) to transport the estimated deformations toward four alien faces constituted by 240 homologous points and identifying a triangulation structure of 416 triangles. We used both local and global criteria for evaluating the performance of the 4 methods, e.g., the maintenance of the original deformation. We found DT, LS and FS very effective in recovering the original deformation while NT fails under several aspects in transporting the shape change. As the best method may differ depending on the application, we recommend carefully testing different methods in order to choose the best one for any specific application.
- Published
- 2021
- Full Text
- View/download PDF