1. Low-latency time-of-flight non-line-of-sight imaging at 5 frames per second
- Author
-
Andreas Velten, Eric Brandt, Alberto Tosi, Eftychios Sifakis, Ji Hyun Nam, Marco Renna, Xiaochun Liu, and Sebastian Bauer
- Subjects
Computer science ,Science ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,General Physics and Astronomy ,Imaging techniques ,02 engineering and technology ,01 natural sciences ,Article ,General Biochemistry, Genetics and Molecular Biology ,010309 optics ,Non-line-of-sight propagation ,0103 physical sciences ,0202 electrical engineering, electronic engineering, information engineering ,Angular resolution ,Computer vision ,Latency (engineering) ,sezele, SPAD ,ComputingMethodologies_COMPUTERGRAPHICS ,Multidisciplinary ,sezele ,business.industry ,Motion blur ,Detector ,Imaging and sensing ,020207 software engineering ,Reconstruction algorithm ,General Chemistry ,Frame rate ,SPAD ,Single-photon avalanche diode ,Computer Science::Computer Vision and Pattern Recognition ,Artificial intelligence ,business ,Applied optics - Abstract
Non-Line-Of-Sight (NLOS) imaging aims at recovering the 3D geometry of objects that are hidden from the direct line of sight. One major challenge with this technique is the weak available multibounce signal limiting scene size, capture speed, and reconstruction quality. To overcome this obstacle, we introduce a multipixel time-of-flight non-line-of-sight imaging method combining specifically designed Single Photon Avalanche Diode (SPAD) array detectors with a fast reconstruction algorithm that captures and reconstructs live low-latency videos of non-line-of-sight scenes with natural non-retroreflective objects. We develop a model of the signal-to-noise-ratio of non-line-of-sight imaging and use it to devise a method that reconstructs the scene such that signal-to-noise-ratio, motion blur, angular resolution, and depth resolution are all independent of scene depth suggesting that reconstruction of very large scenes may be possible., Non-line-of-sight imaging can recover the 3D geometry of hidden objects, but is limited by weak multibounce signals. Here, the authors introduce a multipixel time-of-flight NLOS imaging approach, combining array detectors and a fast algorithm, for live reconstruction of natural nonretroreflective objects.
- Published
- 2021
- Full Text
- View/download PDF