Social Signal Processing: Understanding Social Interactions Through Nonverbal Behavior Analysis

Abstract

This paper introduces social signal processing (SSP), the domain aimed at automatic understanding of social interactions through analysis of nonverbal behavior. The core idea of SSP is that nonverbal behavior is machine detectable evidence of social signals, the relational attitudes exchanged between interacting individuals. Social signals include (dis-)agreement, empathy, hostility, and any other attitude towards others that is expressed not only by words but by nonverbal behaviors such as facial expression and body posture as well. Thus, nonverbal behavior analysis is used as a key to automatic understanding of social interactions. This paper presents not only a survey of the related literature and the main concepts underlying SSP, but also an illustrative example of how such concepts are applied to the analysis of conflicts in competitive discussions.

Cite

Text

Vinciarelli et al. "Social Signal Processing: Understanding Social Interactions Through Nonverbal Behavior Analysis." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2009. doi:10.1109/CVPRW.2009.5204290

Markdown

[Vinciarelli et al. "Social Signal Processing: Understanding Social Interactions Through Nonverbal Behavior Analysis." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2009.](https://mlanthology.org/cvprw/2009/vinciarelli2009cvprw-social/) doi:10.1109/CVPRW.2009.5204290

BibTeX

@inproceedings{vinciarelli2009cvprw-social,
  title     = {{Social Signal Processing: Understanding Social Interactions Through Nonverbal Behavior Analysis}},
  author    = {Vinciarelli, Alessandro and Salamin, Hugues and Pantic, Maja},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2009},
  pages     = {42-49},
  doi       = {10.1109/CVPRW.2009.5204290},
  url       = {https://mlanthology.org/cvprw/2009/vinciarelli2009cvprw-social/}
}