Patches Detection and Fusion for 3D Face Cloning

Abstract : 3D face clones are used in many fields such as video games and Human-Computer Interaction. However, high-resolution sensors generating high quality clones are expensive and not accessible to all. In this paper, we propose to make a fully automated and accurate 3D reconstruction of a face with a low cost RGB-D camera. For each subject, we capture the depth and RGB data of their face in different positions while performing a rotational movement of the head. We fit a 3D Morphable Face Model on each frame to eliminate noise, increase resolution and provide a structured mesh. This type of mesh is a mesh which the semantic and topological structure is known. We propose to only keep the suitable parts of each mesh called Patch. This selection is performed using an error distance and the direction of the normal vectors. To create the 3D face clone, we merge the different patches of each mesh. These patches contain relevant information on the specificity of individuals and lead to the construction of a more accurate clone. We perform quantitative tests by comparing our clone to ground truth and qualitative tests by comparing visual features. These results show that our method outperforms the FaceWarehouse process of Cao et al [2]. This 3D face clone on a structured mesh can be used as pretreatment in applications such as emotion analysis [13] or facial animation.
Liste complète des métadonnées

https://hal-supelec.archives-ouvertes.fr/hal-01232537
Contributeur : Jerome Manceau <>
Soumis le : lundi 23 novembre 2015 - 16:26:53
Dernière modification le : jeudi 5 avril 2018 - 12:30:19

Lien texte intégral

Identifiants

Citation

Jérôme Manceau, Catherine Soladie, Renaud Séguier. Patches Detection and Fusion for 3D Face Cloning. Advances in Image and Video Processing, Society for Science and Education, 2015, 3 (5), pp.17-31. 〈http://scholarpublishing.org/index.php/AIVP/article/view/814/886〉. 〈10.14738/aivp.35.814〉. 〈hal-01232537〉

Partager

Métriques

Consultations de la notice

218