Quick Polytope Approximation of All Correlated Equilibria in Stochastic Games

Abstract

Stochastic or Markov games serve as reasonable models for a variety of domains from biology to computer security, and are appealing due to their versatility. In this paper we address the problem of finding the complete set of correlated equilibria for general-sum stochastic games with perfect information. We present QPACE — an algorithm orders of magnitude more efficient than previous approaches while maintaining a guarantee of convergence and bounded error. Finally, we validate our claims and demonstrate the limits of our algorithm with extensive empirical tests.

Cite

Text

MacDermed et al. "Quick Polytope Approximation of All Correlated Equilibria in Stochastic Games." AAAI Conference on Artificial Intelligence, 2011. doi:10.1609/AAAI.V25I1.7882

Markdown

[MacDermed et al. "Quick Polytope Approximation of All Correlated Equilibria in Stochastic Games." AAAI Conference on Artificial Intelligence, 2011.](https://mlanthology.org/aaai/2011/macdermed2011aaai-quick/) doi:10.1609/AAAI.V25I1.7882

BibTeX

@inproceedings{macdermed2011aaai-quick,
  title     = {{Quick Polytope Approximation of All Correlated Equilibria in Stochastic Games}},
  author    = {MacDermed, Liam and Narayan, Karthik Sankaran and Jr., Charles Lee Isbell and Weiss, Lora},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year      = {2011},
  pages     = {707-712},
  doi       = {10.1609/AAAI.V25I1.7882},
  url       = {https://mlanthology.org/aaai/2011/macdermed2011aaai-quick/}
}