LiDAL: Inter-Frame Uncertainty Based Active Learning for 3D LiDAR Semantic Segmentation

Abstract

We propose LiDAL, a novel active learning method for 3D LiDAR semantic segmentation by exploiting inter-frame uncertainty among LiDAR frames. Our core idea is that a well-trained model should generate robust results irrespective of viewpoints for scene scanning and thus the inconsistencies in model predictions across frames provide a very reliable measure of uncertainty for active sample selection. To implement this uncertainty measure, we introduce new inter-frame divergence and entropy formulations, which serve as the metrics for active selection. Moreover, we demonstrate additional performance gains by predicting and incorporating pseudo-labels, which are also selected using the proposed inter-frame uncertainty measure. Experimental results validate the effectiveness of LiDAL: we achieve 95% of the performance of fully supervised learning with less than 5% of annotations on the SemanticKITTI and nuScenes datasets, outperforming state-of-the-art active learning methods.

Cite

Text

Hu et al. "LiDAL: Inter-Frame Uncertainty Based Active Learning for 3D LiDAR Semantic Segmentation." Proceedings of the European Conference on Computer Vision (ECCV), 2022. doi:10.1007/978-3-031-19812-0_15

Markdown

[Hu et al. "LiDAL: Inter-Frame Uncertainty Based Active Learning for 3D LiDAR Semantic Segmentation." Proceedings of the European Conference on Computer Vision (ECCV), 2022.](https://mlanthology.org/eccv/2022/hu2022eccv-lidal/) doi:10.1007/978-3-031-19812-0_15

BibTeX

@inproceedings{hu2022eccv-lidal,
  title     = {{LiDAL: Inter-Frame Uncertainty Based Active Learning for 3D LiDAR Semantic Segmentation}},
  author    = {Hu, Zeyu and Bai, Xuyang and Zhang, Runze and Wang, Xin and Sun, Guangyuan and Fu, Hongbo and Tai, Chiew-Lan},
  booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
  year      = {2022},
  doi       = {10.1007/978-3-031-19812-0_15},
  url       = {https://mlanthology.org/eccv/2022/hu2022eccv-lidal/}
}