Back to Search Start Over

LiDeNeRF: Neural radiance field reconstruction with depth prior provided by LiDAR point cloud.

Authors :
Wei, Pengcheng
Yan, Li
Xie, Hong
Qiu, Dashi
Qiu, Changcheng
Wu, Hao
Zhao, Yinghao
Hu, Xiao
Huang, Ming
Source :
ISPRS Journal of Photogrammetry & Remote Sensing. Feb2024, Vol. 208, p296-307. 12p.
Publication Year :
2024

Abstract

Neural Radiance Fields (NeRF) is a technique for reconstructing real-world scenes from multiple views. However, existing methods mostly focus on the visual effects of scene reconstruction while neglecting geometric accuracy, which is crucial in photogrammetry and remote sensing. In this paper, we propose a method called LiDeNeRF which uses LiDAR point cloud to provide depth priors for NeRF reconstruction. The goal of LiDeNeRF is to achieve real-time rendering of NeRF scenes and 3D reconstruction results with high geometric accuracy. In this method, first, the LiDAR point cloud is projected onto images to generate a sparse depth map. Then, by triangulating the sparse depth and using a multi-view image depth propagation method, a dense depth map with high accuracy is quickly generated as the depth prior for NeRF. Finally, a new depth correction module is designed and embedded into the NeRF rendering pipeline to improve the accuracy of scene depth estimation. The experimental results evince that our methodology has attained paramount performance in both novel view synthesis and 3D reconstruction tasks. Our source code is made available at https://github.com/WPC-WHU/LiDeNeRF. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09242716
Volume :
208
Database :
Academic Search Index
Journal :
ISPRS Journal of Photogrammetry & Remote Sensing
Publication Type :
Academic Journal
Accession number :
175296797
Full Text :
https://doi.org/10.1016/j.isprsjprs.2024.01.017