ST-Gait++: Leveraging Spatio-Temporal Convolutions for Gait-Based Emotion Recognition on Videos
Abstract
Emotion recognition is relevant for human behaviour understanding, where facial expression and speech recognition have been widely explored by the computer vision community. Literature in the field of behavioural psychology indicates that gait, described as the way a person walks, is an additional indicator of emotions. In this work, we propose a deep framework for emotion recognition through the analysis of gait. More specifically, our model is composed of a sequence of spatial-temporal Graph Convolutional Networks that produce a robust skeleton-based representation for the task of emotion classification. We evaluate our proposed framework on the E-Gait dataset, composed of a total of 2177 samples. The results obtained represent an improvement of ≈ 5% in accuracy compared to the state of the art. In addition, during training we observed a faster convergence of our model compared to the state-of-the-art methodologies.
Cite
Text
Lima et al. "ST-Gait++: Leveraging Spatio-Temporal Convolutions for Gait-Based Emotion Recognition on Videos." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2024. doi:10.1109/CVPRW63382.2024.00035Markdown
[Lima et al. "ST-Gait++: Leveraging Spatio-Temporal Convolutions for Gait-Based Emotion Recognition on Videos." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2024.](https://mlanthology.org/cvprw/2024/lima2024cvprw-stgait/) doi:10.1109/CVPRW63382.2024.00035BibTeX
@inproceedings{lima2024cvprw-stgait,
title = {{ST-Gait++: Leveraging Spatio-Temporal Convolutions for Gait-Based Emotion Recognition on Videos}},
author = {Lima, Maria Luísa and de Lima Costa, Willams and Martínez, Estefania Talavera and Teichrieb, Veronica},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
year = {2024},
pages = {302-310},
doi = {10.1109/CVPRW63382.2024.00035},
url = {https://mlanthology.org/cvprw/2024/lima2024cvprw-stgait/}
}