An Object-Oriented Representation for Efficient Reinforcement Learning
Abstract
Rich representations in reinforcement learning have been studied for the purpose of enabling generalization and making learning feasible in large state spaces. We introduce Object-Oriented MDPs (OO-MDPs), a representation based on objects and their interactions, which is a natural way of modeling environments and offers important generalization opportunities. We introduce a learning algorithm for deterministic OO-MDPs, and prove a polynomial bound in its sample complexity. We illustrate the performance gains of our representation and algorithm in the well-known Taxi domain, plus a real-life videogame.
Cite
Text
Diuk et al. "An Object-Oriented Representation for Efficient Reinforcement Learning." International Conference on Machine Learning, 2008. doi:10.1145/1390156.1390187Markdown
[Diuk et al. "An Object-Oriented Representation for Efficient Reinforcement Learning." International Conference on Machine Learning, 2008.](https://mlanthology.org/icml/2008/diuk2008icml-object/) doi:10.1145/1390156.1390187BibTeX
@inproceedings{diuk2008icml-object,
title = {{An Object-Oriented Representation for Efficient Reinforcement Learning}},
author = {Diuk, Carlos and Cohen, Andre and Littman, Michael L.},
booktitle = {International Conference on Machine Learning},
year = {2008},
pages = {240-247},
doi = {10.1145/1390156.1390187},
url = {https://mlanthology.org/icml/2008/diuk2008icml-object/}
}