Understanding the 3D Layout of a Cluttered Room from Multiple Images

Abstract

We present a novel framework for robustly understanding the geometrical and semantic structure of a cluttered room from a small number of images captured from different viewpoints. The tasks we seek to address include: i) estimating the 3D layout of the room – that is, the 3D configuration of floor, walls and ceiling; ii) identifying and localizing all the foreground objects in the room. We jointly use multiview geometry constraints and image appearance to identify the best room layout configuration. Extensive experimental evaluation demonstrates that our estimation results are more complete and accurate in estimating 3D room structure and recognizing objects than alternative state-of-the-art algorithms. In addition, we show an augmented reality mobile application to highlight the high accuracy of our method, which may be beneficial to many computer vision applications

Cite

Text

Bao et al. "Understanding the 3D Layout of a Cluttered Room from Multiple Images." IEEE/CVF Winter Conference on Applications of Computer Vision, 2014. doi:10.1109/WACV.2014.6836035

Markdown

[Bao et al. "Understanding the 3D Layout of a Cluttered Room from Multiple Images." IEEE/CVF Winter Conference on Applications of Computer Vision, 2014.](https://mlanthology.org/wacv/2014/bao2014wacv-understanding/) doi:10.1109/WACV.2014.6836035

BibTeX

@inproceedings{bao2014wacv-understanding,
  title     = {{Understanding the 3D Layout of a Cluttered Room from Multiple Images}},
  author    = {Bao, Sid Ying-Ze and Furlan, Axel and Fei-Fei, Li and Savarese, Silvio},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
  year      = {2014},
  pages     = {690-697},
  doi       = {10.1109/WACV.2014.6836035},
  url       = {https://mlanthology.org/wacv/2014/bao2014wacv-understanding/}
}