Stereoscopic Inpainting: Joint Color and Depth Completion from Stereo Images

Abstract

We present a novel algorithm for simultaneous color and depth inpainting. The algorithm takes stereo images and estimated disparity maps as input and fills in missing color and depth information introduced by occlusions or object removal. We first complete the disparities for the occlusion regions using a segmentation-based approach. The completed disparities can be used to facilitate the user in labeling objects to be removed. Since part of the removed regions in one image is visible in the other, we mutually complete the two images through 3D warping. Finally, we complete the remaining unknown regions using a depth-assisted texture synthesis technique, which simultaneously fills in both color and depth. We demonstrate the effectiveness of the proposed algorithm on several challenging data sets.

Cite

Text

Wang et al. "Stereoscopic Inpainting: Joint Color and Depth Completion from Stereo Images." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2008. doi:10.1109/CVPR.2008.4587704

Markdown

[Wang et al. "Stereoscopic Inpainting: Joint Color and Depth Completion from Stereo Images." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2008.](https://mlanthology.org/cvpr/2008/wang2008cvpr-stereoscopic/) doi:10.1109/CVPR.2008.4587704

BibTeX

@inproceedings{wang2008cvpr-stereoscopic,
  title     = {{Stereoscopic Inpainting: Joint Color and Depth Completion from Stereo Images}},
  author    = {Wang, Liang and Jin, Hailin and Yang, Ruigang and Gong, Minglun},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year      = {2008},
  doi       = {10.1109/CVPR.2008.4587704},
  url       = {https://mlanthology.org/cvpr/2008/wang2008cvpr-stereoscopic/}
}