SceneFlowFields: Dense Interpolation of Sparse Scene Flow Correspondences

René Schuster, Oliver Wasenmüller, Georg Kuschk, Christian Bailer, Didier Stricker

WACV 2018 pp. 1056-1065

doi:10.1109/WACV.2018.00121 /wacv/2018/schuster2018wacv-sceneflowfields/

Abstract

While most scene flow methods use either variational optimization or a strong rigid motion assumption, we show for the first time that scene flow can also be estimated by dense interpolation of sparse matches. To this end, we find sparse matches across two stereo image pairs that are detected without any prior regularization and perform dense interpolation preserving geometric and motion boundaries by using edge information. A few iterations of variational energy minimization are performed to refine our results, which are thoroughly evaluated on the KITTI benchmark and additionally compared to state-of-the-art on MPI Sintel. For application in an automotive context, we further show that an optional ego-motion model helps to boost performance and blends smoothly into our approach to produce a segmentation of the scene into static and dynamic parts.

PDF WACV Semantic Scholar

Cite

Text

Schuster et al. "SceneFlowFields: Dense Interpolation of Sparse Scene Flow Correspondences." IEEE/CVF Winter Conference on Applications of Computer Vision, 2018. doi:10.1109/WACV.2018.00121

Markdown

[Schuster et al. "SceneFlowFields: Dense Interpolation of Sparse Scene Flow Correspondences." IEEE/CVF Winter Conference on Applications of Computer Vision, 2018.](https://mlanthology.org/wacv/2018/schuster2018wacv-sceneflowfields/) doi:10.1109/WACV.2018.00121

BibTeX

@inproceedings{schuster2018wacv-sceneflowfields,
  title     = {{SceneFlowFields: Dense Interpolation of Sparse Scene Flow Correspondences}},
  author    = {Schuster, René and Wasenmüller, Oliver and Kuschk, Georg and Bailer, Christian and Stricker, Didier},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
  year      = {2018},
  pages     = {1056-1065},
  doi       = {10.1109/WACV.2018.00121},
  url       = {https://mlanthology.org/wacv/2018/schuster2018wacv-sceneflowfields/}
}