3D reconstruction of insects: an improved multifocus stacking and an evaluation of learning-based MVS approaches - Calcul Intensif, Simulation, Optimisation Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

3D reconstruction of insects: an improved multifocus stacking and an evaluation of learning-based MVS approaches

Chang Xu
Chuong Nguyen
  • Fonction : Auteur
  • PersonId : 1114069
Fabien Casten
  • Fonction : Auteur
  • PersonId : 1114070
Benoit Maujean
  • Fonction : Auteur
  • PersonId : 1114071
Simone Gasparini

Résumé

3D reconstruction of insects from photographs is a challenging task as it requires to tackle several problems such as strong out-of-focus areas in macro-photography, thin structures (insect legs and hairs), flat-colored surfaces (insects shells), non-Lambertian (shells specularities) and even translucent surfaces (wings). In this work, we first present a new lens-based image registration technique for accurate multi-focus stacking suitable for 3D reconstruction purposes while other methods create in-focus images for viewing purpose only. We then evaluate and compare the classical Multi-View-Stereo (MVS) reconstruction pipeline for small and complex objects with recent deep learningbased reconstruction methods such as the Neural Radiance Fields (NeRF) and the Neural Sparse Voxel Fields (NSVF). We present an assessment of different sources of errors for the considered methods. The results are compared both quantitatively and qualitatively across the different methods. From this analysis we present a series of practical guidelines for addressing the common issues of the reconstruction of small objects under challenging conditions.
Fichier principal
Vignette du fichier
mainPaper.pdf (55.24 Mo) Télécharger le fichier
supplementary.pdf (14.35 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03386615 , version 1 (19-10-2021)
hal-03386615 , version 2 (22-10-2021)

Identifiants

Citer

Chang Xu, Jiayuan Liu, Chuong Nguyen, Fabien Casten, Benoit Maujean, et al.. 3D reconstruction of insects: an improved multifocus stacking and an evaluation of learning-based MVS approaches. International Conference on 3D Vision (3DV), Dec 2021, London, United Kingdom. ⟨10.1109/3DV53792.2021.00148⟩. ⟨hal-03386615v2⟩
292 Consultations
65 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More