Interactive Learning of Mappings from Visual Percepts to Actions

Abstract

We introduce flexible algorithms that can automatically learn mappings from images to actions by interacting with their environment. They work by introducing an image classifier in front of a Reinforcement Learning algorithm. The classifier partitions the visual space according to the presence or absence of highly informative local descriptors. The image classifier is incrementally refined by selecting new local descriptors when perceptual aliasing is detected. Thus, we reduce the visual input domain down to a size manageable by Reinforcement Learning, permitting us to learn direct percept-to-action mappings. Experimental results on a continuous visual navigation task illustrate the applicability of the framework. 1.

Cite

Text

Jodogne and Piater. "Interactive Learning of Mappings from Visual Percepts to Actions." International Conference on Machine Learning, 2005. doi:10.1145/1102351.1102401

Markdown

[Jodogne and Piater. "Interactive Learning of Mappings from Visual Percepts to Actions." International Conference on Machine Learning, 2005.](https://mlanthology.org/icml/2005/jodogne2005icml-interactive/) doi:10.1145/1102351.1102401

BibTeX

@inproceedings{jodogne2005icml-interactive,
  title     = {{Interactive Learning of Mappings from Visual Percepts to Actions}},
  author    = {Jodogne, Sébastien and Piater, Justus H.},
  booktitle = {International Conference on Machine Learning},
  year      = {2005},
  pages     = {393-400},
  doi       = {10.1145/1102351.1102401},
  url       = {https://mlanthology.org/icml/2005/jodogne2005icml-interactive/}
}