The Instantaneous Accuracy: A Novel Metric for the Problem of Online Human Behaviour Recognition in Untrimmed Videos

Marcos Baptista-Ríos, Roberto Javier López-Sastre, Fabian Caba Heilbron, Jan van Gemert, Francisco Javier Acevedo-Rodríguez, Saturnino Maldonado-Bascón

ICCVW 2019 pp. 1282-1284

doi:10.1109/ICCVW.2019.00162 /iccvw/2019/baptistarios2019iccvw-instantaneous/

Abstract

The problem of Online Human Behavior Recognition in untrimmed videos, aka Online Action Detection (OAD), needs to be revisited. Unlike traditional off-line action detection approaches, where the evaluation metrics are clear and well established, in the OAD setting we find few works and no consensus on evaluation protocols to be used. In this paper we introduce a novel online metric, the Instantaneous Accuracy (IA), that exhibits an online nature, solving most of the limitations of the previous (off-line) metrics. We conduct a thorough experimental evaluation on the TVSeries dataset, comparing the performance of various baseline methods with the state of the art. Our results confirm the problems of the previous evaluation protocols, and suggest that an IA-based protocol is more adequate to the online scenario for human behaviour understanding.

PDF ICCVW Semantic Scholar

Cite

Text

Baptista-Ríos et al. "The Instantaneous Accuracy: A Novel Metric for the Problem of Online Human Behaviour Recognition in Untrimmed Videos." IEEE/CVF International Conference on Computer Vision Workshops, 2019. doi:10.1109/ICCVW.2019.00162

Markdown

[Baptista-Ríos et al. "The Instantaneous Accuracy: A Novel Metric for the Problem of Online Human Behaviour Recognition in Untrimmed Videos." IEEE/CVF International Conference on Computer Vision Workshops, 2019.](https://mlanthology.org/iccvw/2019/baptistarios2019iccvw-instantaneous/) doi:10.1109/ICCVW.2019.00162

BibTeX

@inproceedings{baptistarios2019iccvw-instantaneous,
  title     = {{The Instantaneous Accuracy: A Novel Metric for the Problem of Online Human Behaviour Recognition in Untrimmed Videos}},
  author    = {Baptista-Ríos, Marcos and López-Sastre, Roberto Javier and Heilbron, Fabian Caba and van Gemert, Jan and Acevedo-Rodríguez, Francisco Javier and Maldonado-Bascón, Saturnino},
  booktitle = {IEEE/CVF International Conference on Computer Vision Workshops},
  year      = {2019},
  pages     = {1282-1284},
  doi       = {10.1109/ICCVW.2019.00162},
  url       = {https://mlanthology.org/iccvw/2019/baptistarios2019iccvw-instantaneous/}
}