Eliciting Additive Reward Functions for Markov Decision Processes
Abstract
Specifying the reward function of a Markov decision process (MDP) can be demanding, requiring human assessment of the precise quality of, and tradeoffs among, various states and actions. However, reward functions often possess considerable structure which can be leveraged to streamline their specification. We develop new, decision-theoretically sound heuristics for eliciting rewards for factored MDPs whose reward functions exhibit additive independence. Since we can often find good policies without complete reward specification, we also develop new (exact and approximate) algorithms for robust optimization ofimprecise-reward MDPs with such additive reward. Our methods are evaluated in two domains: autonomic computing and assistive technology.
Cite
Text
Regan and Boutilier. "Eliciting Additive Reward Functions for Markov Decision Processes." International Joint Conference on Artificial Intelligence, 2011. doi:10.5591/978-1-57735-516-8/IJCAI11-360Markdown
[Regan and Boutilier. "Eliciting Additive Reward Functions for Markov Decision Processes." International Joint Conference on Artificial Intelligence, 2011.](https://mlanthology.org/ijcai/2011/regan2011ijcai-eliciting/) doi:10.5591/978-1-57735-516-8/IJCAI11-360BibTeX
@inproceedings{regan2011ijcai-eliciting,
title = {{Eliciting Additive Reward Functions for Markov Decision Processes}},
author = {Regan, Kevin and Boutilier, Craig},
booktitle = {International Joint Conference on Artificial Intelligence},
year = {2011},
pages = {2159-2164},
doi = {10.5591/978-1-57735-516-8/IJCAI11-360},
url = {https://mlanthology.org/ijcai/2011/regan2011ijcai-eliciting/}
}