JRDB-Social: A Multifaceted Robotic Dataset for Understanding of Context and Dynamics of Human Interactions Within Social Groups
Abstract
Understanding human social behaviour is crucial in computer vision and robotics. Micro-level observations like individual actions fall short necessitating a comprehensive approach that considers individual behaviour intra-group dynamics and social group levels for a thorough understanding. To address dataset limitations this paper introduces JRDB-Social an extension of JRDB. Designed to fill gaps in human understanding across diverse indoor and outdoor social contexts JRDB-Social provides annotations at three levels: individual attributes intra-group interactions and social group context. This dataset aims to enhance our grasp of human social dynamics for robotic applications. Utilizing the recent cutting-edge multi-modal large language models we evaluated our benchmark to explore their capacity to decipher social human behaviour.
Cite
Text
Jahangard et al. "JRDB-Social: A Multifaceted Robotic Dataset for Understanding of Context and Dynamics of Human Interactions Within Social Groups." Conference on Computer Vision and Pattern Recognition, 2024. doi:10.1109/CVPR52733.2024.02085Markdown
[Jahangard et al. "JRDB-Social: A Multifaceted Robotic Dataset for Understanding of Context and Dynamics of Human Interactions Within Social Groups." Conference on Computer Vision and Pattern Recognition, 2024.](https://mlanthology.org/cvpr/2024/jahangard2024cvpr-jrdbsocial/) doi:10.1109/CVPR52733.2024.02085BibTeX
@inproceedings{jahangard2024cvpr-jrdbsocial,
title = {{JRDB-Social: A Multifaceted Robotic Dataset for Understanding of Context and Dynamics of Human Interactions Within Social Groups}},
author = {Jahangard, Simindokht and Cai, Zhixi and Wen, Shiki and Rezatofighi, Hamid},
booktitle = {Conference on Computer Vision and Pattern Recognition},
year = {2024},
pages = {22087-22097},
doi = {10.1109/CVPR52733.2024.02085},
url = {https://mlanthology.org/cvpr/2024/jahangard2024cvpr-jrdbsocial/}
}