Adaptive Aggregation for Reinforcement Learning with Efficient Exploration: Deterministic Domains
Abstract
We propose a model-based learning algorithm, the Adaptive Aggregation Algorithm (AAA), that aims to solve the online, continuous state space reinforcement learning problem in a deterministic domain. The proposed algorithm uses an adaptive state aggregation approach, going from coarse to fine grids over the state space, which enables to use finer resolution in the "important" areas of the state space, and coarser resolution elsewhere. We consider an on-line learning approach, in which we discover these important areas on-line, using an uncertainty intervals exploration technique. Polynomial learning rates in terms of mistake bound (in a PAC framework) are established for this algorithm, under appropriate continuity assumptions.
Cite
Text
Bernstein and Shimkin. "Adaptive Aggregation for Reinforcement Learning with Efficient Exploration: Deterministic Domains." Annual Conference on Computational Learning Theory, 2008.Markdown
[Bernstein and Shimkin. "Adaptive Aggregation for Reinforcement Learning with Efficient Exploration: Deterministic Domains." Annual Conference on Computational Learning Theory, 2008.](https://mlanthology.org/colt/2008/bernstein2008colt-adaptive/)BibTeX
@inproceedings{bernstein2008colt-adaptive,
title = {{Adaptive Aggregation for Reinforcement Learning with Efficient Exploration: Deterministic Domains}},
author = {Bernstein, Andrey and Shimkin, Nahum},
booktitle = {Annual Conference on Computational Learning Theory},
year = {2008},
pages = {323-334},
url = {https://mlanthology.org/colt/2008/bernstein2008colt-adaptive/}
}