Continuous Depth Estimation for Multi-View Stereo

Abstract

Depth-map merging approaches have become more and more popular in multi-view stereo (MVS) because of their flexibility and superior performance. The quality of depth map used for merging is vital for accurate 3D reconstruction. While traditional depth map estimation has been performed in a discrete manner, we suggest the use of a continuous counterpart. In this paper, we first integrate silhouette information and epipolar constraint into the variational method for continuous depth map estimation. Then, several depth candidates are generated based on a multiple starting scales (MSS) framework. From these candidates, refined depth maps for each view are synthesized according to path-based NCC (normalized cross correlation) metric. Finally, the multiview depth maps are merged to produce 3D models. Our algorithm excels at detail capture and produces one of the most accurate results among the current algorithms for sparse MVS datasets according to the Middlebury benchmark. Additionally, our approach shows its outstanding robustness and accuracy in free-viewpoint video scenario.

Cite

Text

Liu et al. "Continuous Depth Estimation for Multi-View Stereo." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2009. doi:10.1109/CVPR.2009.5206712

Markdown

[Liu et al. "Continuous Depth Estimation for Multi-View Stereo." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2009.](https://mlanthology.org/cvpr/2009/liu2009cvpr-continuous/) doi:10.1109/CVPR.2009.5206712

BibTeX

@inproceedings{liu2009cvpr-continuous,
  title     = {{Continuous Depth Estimation for Multi-View Stereo}},
  author    = {Liu, Yebin and Cao, Xun and Dai, Qionghai and Xu, Wenli},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year      = {2009},
  pages     = {2121-2128},
  doi       = {10.1109/CVPR.2009.5206712},
  url       = {https://mlanthology.org/cvpr/2009/liu2009cvpr-continuous/}
}