Teaching a Machine to Read Maps with Deep Reinforcement Learning
Abstract
The ability to use a 2D map to navigate a complex 3D environment is quite remarkable, and even difficult for many humans. Localization and navigation is also an important problem in domains such as robotics, and has recently become a focus of the deep reinforcement learning community. In this paper we teach a reinforcement learning agent to read a map in order to find the shortest way out of a random maze it has never seen before. Our system combines several state-of-the-art methods such as A3C and incorporates novel elements such as a recurrent localization cell. Our agent learns to localize itself based on 3D first person images and an approximate orientation angle. The agent generalizes well to bigger mazes, showing that it learned useful localization and navigation capabilities.
Cite
Text
Brunner et al. "Teaching a Machine to Read Maps with Deep Reinforcement Learning." AAAI Conference on Artificial Intelligence, 2018. doi:10.1609/AAAI.V32I1.11645Markdown
[Brunner et al. "Teaching a Machine to Read Maps with Deep Reinforcement Learning." AAAI Conference on Artificial Intelligence, 2018.](https://mlanthology.org/aaai/2018/brunner2018aaai-teaching/) doi:10.1609/AAAI.V32I1.11645BibTeX
@inproceedings{brunner2018aaai-teaching,
title = {{Teaching a Machine to Read Maps with Deep Reinforcement Learning}},
author = {Brunner, Gino and Richter, Oliver and Wang, Yuyi and Wattenhofer, Roger},
booktitle = {AAAI Conference on Artificial Intelligence},
year = {2018},
pages = {2763-2770},
doi = {10.1609/AAAI.V32I1.11645},
url = {https://mlanthology.org/aaai/2018/brunner2018aaai-teaching/}
}