High-Level Features for Multimodal Deception Detection in Videos
Abstract
Deception (the action of deliberately cause someone to believe something that is not true) can have many different repercussions in daily life. However, deception detection is an inherently complex task for humans. Due to this, not only there is uncertainty on which features should be used as cues for automatic deception detection, but labeled data is scarce. In this paper, we explore typical features that can be extracted from videos for affective computing and study their performance for deception detection in videos. Additionally, we perform a study of different multimodal fusion methods meant to improve the results obtained by using the different sets of extracted features separately, including a novel set of methods based on boosting. For this study, high level features are extracted with open automatic tools for the visual, acoustical and textual modalities, respectively. Experiments are conducted using a real-life trial dataset for deception detection, as well as a novel Mexican deception detection dataset using Spanish as the spoken language.
Cite
Text
Rill-García et al. "High-Level Features for Multimodal Deception Detection in Videos." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2019. doi:10.1109/CVPRW.2019.00198Markdown
[Rill-García et al. "High-Level Features for Multimodal Deception Detection in Videos." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2019.](https://mlanthology.org/cvprw/2019/rillgarcia2019cvprw-highlevel/) doi:10.1109/CVPRW.2019.00198BibTeX
@inproceedings{rillgarcia2019cvprw-highlevel,
title = {{High-Level Features for Multimodal Deception Detection in Videos}},
author = {Rill-García, Rodrigo and Escalante, Hugo Jair and Pineda, Luis Villaseñor and Reyes-Meza, Verónica},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
year = {2019},
pages = {1565-1573},
doi = {10.1109/CVPRW.2019.00198},
url = {https://mlanthology.org/cvprw/2019/rillgarcia2019cvprw-highlevel/}
}