Width-Based Algorithms for Common Problems in Control, Planning and Reinforcement Learning

Abstract

Width-based algorithms search for solutions through a general definition of state novelty. These algorithms have been shown to result in state-of-the-art performance in classical planning, and have been successfully applied to model-based and model-free settings where the dynamics of the problem are given through simulation engines. Width-based algorithms performance is understood theoretically through the notion of planning width, providing polynomial guarantees on their runtime and memory consumption. To facilitate synergies across research communities, this paper summarizes the area of width-based planning, and surveys current and future research directions.

Cite

Text

Lipovetzky. "Width-Based Algorithms for Common Problems in Control, Planning and Reinforcement Learning." International Joint Conference on Artificial Intelligence, 2021. doi:10.24963/IJCAI.2021/702

Markdown

[Lipovetzky. "Width-Based Algorithms for Common Problems in Control, Planning and Reinforcement Learning." International Joint Conference on Artificial Intelligence, 2021.](https://mlanthology.org/ijcai/2021/lipovetzky2021ijcai-width/) doi:10.24963/IJCAI.2021/702

BibTeX

@inproceedings{lipovetzky2021ijcai-width,
  title     = {{Width-Based Algorithms for Common Problems in Control, Planning and Reinforcement Learning}},
  author    = {Lipovetzky, Nir},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2021},
  pages     = {4956-4960},
  doi       = {10.24963/IJCAI.2021/702},
  url       = {https://mlanthology.org/ijcai/2021/lipovetzky2021ijcai-width/}
}