Abstracting Complex Domains Using Modular Object-Oriented Markov Decision Processes

Abstract

We present an initial proposal for modular object-oriented MDPs, an extension of OO-MDPs that abstracts complex domains that are partially observable and stochastic with multiple goals. Modes reduce the curse of dimensionality by reducing the number of attributes, objects, and actions into only the features relevant for each goal. These modes may also be used as an abstracted domain to be transferred to other modes or to another domain.

Cite

Text

Squire and desJardins. "Abstracting Complex Domains Using Modular Object-Oriented Markov Decision Processes." AAAI Conference on Artificial Intelligence, 2016. doi:10.1609/AAAI.V30I1.9964

Markdown

[Squire and desJardins. "Abstracting Complex Domains Using Modular Object-Oriented Markov Decision Processes." AAAI Conference on Artificial Intelligence, 2016.](https://mlanthology.org/aaai/2016/squire2016aaai-abstracting/) doi:10.1609/AAAI.V30I1.9964

BibTeX

@inproceedings{squire2016aaai-abstracting,
  title     = {{Abstracting Complex Domains Using Modular Object-Oriented Markov Decision Processes}},
  author    = {Squire, Shawn and desJardins, Marie},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year      = {2016},
  pages     = {4264-4265},
  doi       = {10.1609/AAAI.V30I1.9964},
  url       = {https://mlanthology.org/aaai/2016/squire2016aaai-abstracting/}
}