Perceptual Narratives of Space and Motion for Semantic Interpretation of Visual Data

Abstract

We propose a commonsense theory of space and motion for the high-level semantic interpretation of dynamic scenes. The theory provides primitives for commonsense representation and reasoning with qualitative spatial relations, depth profiles , and spatio-temporal change ; these may be combined with probabilistic methods for modelling and hypothesising event and object relations. The proposed framework has been implemented as a general activity abstraction and reasoning engine, which we demonstrate by generating declaratively grounded visuo-spatial narratives of perceptual input from vision and depth sensors for a benchmark scenario. Our long-term goal is to provide general tools (integrating different aspects of space, action, and change) necessary for tasks such as real-time human activity interpretation and dynamic sensor control within the purview of cognitive vision, interaction, and control.

Cite

Text

Suchan et al. "Perceptual Narratives of Space and Motion for Semantic Interpretation of Visual Data." European Conference on Computer Vision Workshops, 2014. doi:10.1007/978-3-319-16181-5_24

Markdown

[Suchan et al. "Perceptual Narratives of Space and Motion for Semantic Interpretation of Visual Data." European Conference on Computer Vision Workshops, 2014.](https://mlanthology.org/eccvw/2014/suchan2014eccvw-perceptual/) doi:10.1007/978-3-319-16181-5_24

BibTeX

@inproceedings{suchan2014eccvw-perceptual,
  title     = {{Perceptual Narratives of Space and Motion for Semantic Interpretation of Visual Data}},
  author    = {Suchan, Jakob and Bhatt, Mehul and Santos, Paulo E.},
  booktitle = {European Conference on Computer Vision Workshops},
  year      = {2014},
  pages     = {339-354},
  doi       = {10.1007/978-3-319-16181-5_24},
  url       = {https://mlanthology.org/eccvw/2014/suchan2014eccvw-perceptual/}
}