1. Joint Image and Depth Estimation With Mask-Based Lensless Cameras
- Author
-
Zheng, Yucheng and Asif, M Salman
- Subjects
Information and Computing Sciences ,Graphics ,Augmented Reality and Games ,Engineering ,Computer Vision and Multimedia Computation ,Lensless imaging ,flatcam ,depth estimation ,non-convex optimization ,alternating minimization ,eess.IV ,cs.CV ,Communications engineering ,Computer vision and multimedia computation ,Numerical and computational mathematics - Abstract
Mask-based lensless cameras replace the lens of a conventional camera with a custom mask. These cameras can potentially be very thin and even flexible. Recently, it has been demonstrated that such mask-based cameras can recover light intensity and depth information of a scene. Existing depth recovery algorithms either assume that the scene consists of a small number of depth planes or solve a sparse recovery problem over a large 3D volume. Both these approaches fail to recover the scenes with large depth variations. In this paper, we propose a new approach for depth estimation based on an alternating gradient descent algorithm that jointly estimates a continuous depth map and light distribution of the unknown scene from its lensless measurements. We present simulation results on image and depth reconstruction for a variety of 3D test scenes. A comparison between the proposed algorithm and other method shows that our algorithm is more robust for natural scenes with a large range of depths. We built a prototype lensless camera and present experimental results for reconstruction of intensity and depth maps of different real objects.
- Published
- 2020