Online Continuous Generalized Category Discovery

Abstract

With the advancement of deep neural networks in computer vision, artificial intelligence (AI) is widely employed in real-world applications. However, AI still faces limitations in mimicking high-level human capabilities, such as novel category discovery, for practical use. While some methods utilizing offline continual learning have been proposed for novel category discovery, they neglect the continuity of data streams in real-world settings. In this work, we introduce Online Continuous Generalized Category Discovery (OCGCD), which considers the dynamic nature of data streams where data can be created and deleted in real time. Additionally, we propose a novel method, DEAN, Discovery via Energy guidance and feature AugmentatioN, which can discover novel categories in an online manner through energy-guided discovery and facilitate discriminative learning via energy-based contrastive loss. Furthermore, DEAN effectively pseudo-labels unlabeled data through variance-based feature augmentation. Experimental results demonstrate that our proposed DEAN achieves outstanding performance in proposed OCGCD scenario. The implementation code is available at https://github.com/KHU-AGI/OCGCD.

Cite

Text

Park et al. "Online Continuous Generalized Category Discovery." Proceedings of the European Conference on Computer Vision (ECCV), 2024. doi:10.1007/978-3-031-73004-7_4

Markdown

[Park et al. "Online Continuous Generalized Category Discovery." Proceedings of the European Conference on Computer Vision (ECCV), 2024.](https://mlanthology.org/eccv/2024/park2024eccv-online/) doi:10.1007/978-3-031-73004-7_4

BibTeX

@inproceedings{park2024eccv-online,
  title     = {{Online Continuous Generalized Category Discovery}},
  author    = {Park, Keon-Hee and Lee, Hakyung and Song, Kyungwoo and Park, Gyeong-Moon},
  booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
  year      = {2024},
  doi       = {10.1007/978-3-031-73004-7_4},
  url       = {https://mlanthology.org/eccv/2024/park2024eccv-online/}
}