An Efficient Approach to Model-Based Hierarchical Reinforcement Learning
Abstract
We propose a model-based approach to hierarchical reinforcement learning that exploits shared knowledge and selective execution at different levels of abstraction, to efficiently solve large, complex problems. Our framework adopts a new transition dynamics learning algorithm that identifies the common action-feature combinations of the subtasks, and evaluates the subtask execution choices through simulation. The framework is sample efficient, and tolerates uncertain and incomplete problem characterization of the subtasks. We test the framework on common benchmark problems and complex simulated robotic environments. It compares favorably against the state-of-the-art algorithms, and scales well in very large problems.
Cite
Text
Li et al. "An Efficient Approach to Model-Based Hierarchical Reinforcement Learning." AAAI Conference on Artificial Intelligence, 2017. doi:10.1609/AAAI.V31I1.11024Markdown
[Li et al. "An Efficient Approach to Model-Based Hierarchical Reinforcement Learning." AAAI Conference on Artificial Intelligence, 2017.](https://mlanthology.org/aaai/2017/li2017aaai-efficient/) doi:10.1609/AAAI.V31I1.11024BibTeX
@inproceedings{li2017aaai-efficient,
title = {{An Efficient Approach to Model-Based Hierarchical Reinforcement Learning}},
author = {Li, Zhuoru and Narayan, Akshay and Leong, Tze-Yun},
booktitle = {AAAI Conference on Artificial Intelligence},
year = {2017},
pages = {3583-3589},
doi = {10.1609/AAAI.V31I1.11024},
url = {https://mlanthology.org/aaai/2017/li2017aaai-efficient/}
}