Abstracting Imperfect Information Away from Two-Player Zero-Sum Games

Abstract

In their seminal work, Nayyar et al. (2013) showed that imperfect information can be abstracted away from common-payoff games by having players publicly announce their policies as they play. This insight underpins sound solvers and decision-time planning algorithms for common-payoff games. Unfortunately, a naive application of the same insight to two-player zero-sum games fails because Nash equilibria of the game with public policy announcements may not correspond to Nash equilibria of the original game. As a consequence, existing sound decision-time planning algorithms require complicated additional mechanisms that have unappealing properties. The main contribution of this work is showing that certain regularized equilibria do not possess the aforementioned non-correspondence problem—thus, computing them can be treated as perfect-information problems. Because these regularized equilibria can be made arbitrarily close to Nash equilibria, our result opens the door to a new perspective to solving two-player zero-sum games and yields a simplified framework for decision-time planning in two-player zero-sum games, void of the unappealing properties that plague existing decision-time planning approaches.

Cite

Text

Sokota et al. "Abstracting Imperfect Information Away from Two-Player Zero-Sum Games." International Conference on Machine Learning, 2023.

Markdown

[Sokota et al. "Abstracting Imperfect Information Away from Two-Player Zero-Sum Games." International Conference on Machine Learning, 2023.](https://mlanthology.org/icml/2023/sokota2023icml-abstracting/)

BibTeX

@inproceedings{sokota2023icml-abstracting,
  title     = {{Abstracting Imperfect Information Away from Two-Player Zero-Sum Games}},
  author    = {Sokota, Samuel and D’Orazio, Ryan and Ling, Chun Kai and Wu, David J and Kolter, J Zico and Brown, Noam},
  booktitle = {International Conference on Machine Learning},
  year      = {2023},
  pages     = {32169-32193},
  volume    = {202},
  url       = {https://mlanthology.org/icml/2023/sokota2023icml-abstracting/}
}