A Novel Method of Multi-view Virtual Image Synthesis for Auto-stereoscopic Display

In this paper, an efficient depth image based view rendering method for high quality multi-view virtual images synthesis is proposed, which utilizes two color images with their associated depth maps. The proposed method consists of four main steps. The first step is virtual camera parameters design by using shift-sensor camera model to avoid the keystone distortion during virtual view synthesis. Secondly, the mixed color pixels around the boundary of image objects is detected and skipped in the following step, which can eliminate the “ghost” artifacts. Then the two input color images are rendered to multiple virtual view positions on the basis of depth-image-based rendering (DIBR) and merged into one image. Finally, a depth-aided inpainting algorithm is used to fill the disoccluded areas. Experiment results are shown to demonstrate the superior performance of the proposed method compared to other traditional DIBR methods.