Automatic Identification of Window Regions on Indoor Point Clouds Using LiDAR and Cameras
Abstract
In this paper, we propose an algorithm to automatically identify window regions on exterior facing facades of buildings using interior 3D point cloud resulting from an ambulatory backpack sensor system, outfitted with multiple LiDAR sensors and cameras. We develop a set of discriminative features for the task, namely visual brightness, infrared opaqueness, and an occlusion indicator, within a Markov Random Field (MRF) framework to provide structured prediction for window or glass regions. A preprocessing classifier is trained on the features to produce node potentials, and large margin parameter training is used to boost performance. Our algorithm has been trained on data taken at the 3 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">rd</sup> floor of Cory Hall at UC Berkeley, with a total façade area of 269.1 m <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> , and has been tested on walls taken on the 2 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">nd</sup> floor of Cory Hall, a Walgreens, and an office building in San Francisco, with a total exterior façade area of 454.6 m <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> . Window regions are successfully identified with 85.5% F <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> -score and 94.2% accuracy.
Cite
Text
Zhang and Zakhor. "Automatic Identification of Window Regions on Indoor Point Clouds Using LiDAR and Cameras." IEEE/CVF Winter Conference on Applications of Computer Vision, 2014. doi:10.1109/WACV.2014.6836112Markdown
[Zhang and Zakhor. "Automatic Identification of Window Regions on Indoor Point Clouds Using LiDAR and Cameras." IEEE/CVF Winter Conference on Applications of Computer Vision, 2014.](https://mlanthology.org/wacv/2014/zhang2014wacv-automatic/) doi:10.1109/WACV.2014.6836112BibTeX
@inproceedings{zhang2014wacv-automatic,
title = {{Automatic Identification of Window Regions on Indoor Point Clouds Using LiDAR and Cameras}},
author = {Zhang, Richard and Zakhor, Avideh},
booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
year = {2014},
pages = {107-114},
doi = {10.1109/WACV.2014.6836112},
url = {https://mlanthology.org/wacv/2014/zhang2014wacv-automatic/}
}