Active Gesture Recognition Using Learned Visual Attention

Abstract

We have developed a foveated gesture recognition system that runs in an unconstrained office environment with an active camera. Us(cid:173) ing vision routines previously implemented for an interactive envi(cid:173) ronment, we determine the spatial location of salient body parts of a user and guide an active camera to obtain images of gestures or expressions. A hidden-state reinforcement learning paradigm is used to implement visual attention. The attention module selects targets to foveate based on the goal of successful recognition, and uses a new multiple-model Q-Iearning formulation. Given a set of target and distractor gestures, our system can learn where to foveate to maximally discriminate a particular gesture.

Cite

Text

Darrell and Pentland. "Active Gesture Recognition Using Learned Visual Attention." Neural Information Processing Systems, 1995.

Markdown

[Darrell and Pentland. "Active Gesture Recognition Using Learned Visual Attention." Neural Information Processing Systems, 1995.](https://mlanthology.org/neurips/1995/darrell1995neurips-active/)

BibTeX

@inproceedings{darrell1995neurips-active,
  title     = {{Active Gesture Recognition Using Learned Visual Attention}},
  author    = {Darrell, Trevor and Pentland, Alex},
  booktitle = {Neural Information Processing Systems},
  year      = {1995},
  pages     = {858-864},
  url       = {https://mlanthology.org/neurips/1995/darrell1995neurips-active/}
}