ML Anthology

A Principled Approach to Detecting Surprising Events in Video

Laurent Itti, Pierre Baldi
CVPR 2005 pp. 631-637
doi:10.1109/CVPR.2005.40 /cvpr/2005/itti2005cvpr-principled/

Abstract

Primates demonstrate unparalleled ability at rapidly orienting towards important events in complex dynamic environments. During rapid guidance of attention and gaze towards potential objects of interest or threats, often there is no time for detailed visual analysis. Thus, heuristic computations are necessary to locate the most interesting events in quasi real-time. We present a new theory of sensory surprise, which provides a principled and computable shortcut to important information. We develop a model that computes instantaneous low-level surprise at every location in video streams. The algorithm significantly correlates with eye movements of two humans watching complex video clips, including television programs (17,936 frames, 2,152 saccadic gaze shifts). The system allows more sophisticated and time-consuming image analysis to be efficiently focused onto the most surprising subsets of the incoming data.

PDF CVPR Semantic Scholar

Cite

Text

Itti and Baldi. "A Principled Approach to Detecting Surprising Events in Video." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2005. doi:10.1109/CVPR.2005.40

Markdown

[Itti and Baldi. "A Principled Approach to Detecting Surprising Events in Video." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2005.](https://mlanthology.org/cvpr/2005/itti2005cvpr-principled/) doi:10.1109/CVPR.2005.40

BibTeX

@inproceedings{itti2005cvpr-principled,
  title     = {{A Principled Approach to Detecting Surprising Events in Video}},
  author    = {Itti, Laurent and Baldi, Pierre},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year      = {2005},
  pages     = {631-637},
  doi       = {10.1109/CVPR.2005.40},
  url       = {https://mlanthology.org/cvpr/2005/itti2005cvpr-principled/}
}