1. FusionMLS: Highly dynamic 3D reconstruction with consumer-grade RGB-D cameras
- Author
-
Siim Meerits, Vincent Nozick, Diego Thomas, Hideo Saito, hyper vision research lab (hvrl), Kyushu University [Fukuoka], Laboratoire d'Informatique Gaspard-Monge (LIGM), Centre National de la Recherche Scientifique (CNRS)-Fédération de Recherche Bézout-ESIEE Paris-École des Ponts ParisTech (ENPC)-Université Paris-Est Marne-la-Vallée (UPEM), Japanese French Laboratory for Informatics (JFLI), National Institute of Informatics (NII)-Université Pierre et Marie Curie - Paris 6 (UPMC)-The University of Tokyo (UTokyo)-Centre National de la Recherche Scientifique (CNRS), and Université Paris-Est Marne-la-Vallée (UPEM)-École des Ponts ParisTech (ENPC)-ESIEE Paris-Fédération de Recherche Bézout-Centre National de la Recherche Scientifique (CNRS)
- Subjects
Computer science ,Automatic identification and data capture ,GPU ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,02 engineering and technology ,Motion capture ,lcsh:QA75.5-76.95 ,Computer graphics ,Artificial Intelligence ,motion capture ,0202 electrical engineering, electronic engineering, information engineering ,Polygon mesh ,Computer vision ,3D reconstruction ,ComputingMethodologies_COMPUTERGRAPHICS ,business.industry ,RGB-D cameras ,[INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV] ,020207 software engineering ,Computer Graphics and Computer-Aided Design ,[INFO.INFO-TI]Computer Science [cs]/Image Processing [eess.IV] ,RGB color model ,020201 artificial intelligence & image processing ,lcsh:Electronic computers. Computer science ,Computer Vision and Pattern Recognition ,Artificial intelligence ,Motion interpolation ,Moving least squares ,business - Abstract
International audience; Multi-view dynamic three-dimensional reconstruction has typically required the use of custom shutter-synchronized camera rigs in order to capture scenes containing rapid movements or complex topology changes. In this paper, we demonstrate that multiple unsynchronized low-cost RGB-D cameras can be used for the same purpose. To alleviate issues caused by unsynchronized shutters, we propose a novel depth frame interpolation technique that allows synchronized data capture from highly dynamic 3D scenes. To manage the resulting huge number of input depth images, we also introduce an efficient moving least squares-based volumetric reconstruction method that generates triangle meshes of the scene. Our approach does not store the reconstruction volume in memory, making it memory-efficient and scalable to large scenes. Our implementation is completely GPU based and works in real time. The results shown herein, obtained with real data, demonstrate the effectiveness of our proposed method and its advantages compared to state-of-the-art approaches.
- Published
- 2018
- Full Text
- View/download PDF