Generating Behavior-Diverse Game AIs with Evolutionary Multi-Objective Deep Reinforcement Learning

Ruimin Shen, Yan Zheng, Jianye Hao, Zhaopeng Meng, Yingfeng Chen, Changjie Fan, Yang Liu

IJCAI 2020 pp. 3371-3377

doi:10.24963/IJCAI.2020/466 /ijcai/2020/shen2020ijcai-generating/

Abstract

Generating diverse behaviors for game artificial intelligence (Game AI) has been long recognized as a challenging task in the game industry. Designing a Game AI with a satisfying behavioral characteristic (style) heavily depends on the domain knowledge and is hard to achieve manually. Deep reinforcement learning sheds light on advancing the automatic Game AI design. However, most of them focus on creating a superhuman Game AI, ignoring the importance of behavioral diversity in games. To bridge the gap, we introduce a new framework, named EMOGI, which can automatically generate desirable styles with almost no domain knowledge. More importantly, EMOGI succeeds in creating a range of diverse styles, providing behavior-diverse Game AIs. Evaluations on the Atari and real commercial games indicate that, compared to existing algorithms, EMOGI performs better in generating diverse behaviors and significantly improves the efficiency of Game AI design.

PDF IJCAI Semantic Scholar

Cite

Text

Shen et al. "Generating Behavior-Diverse Game AIs with Evolutionary Multi-Objective Deep Reinforcement Learning." International Joint Conference on Artificial Intelligence, 2020. doi:10.24963/IJCAI.2020/466

Markdown

[Shen et al. "Generating Behavior-Diverse Game AIs with Evolutionary Multi-Objective Deep Reinforcement Learning." International Joint Conference on Artificial Intelligence, 2020.](https://mlanthology.org/ijcai/2020/shen2020ijcai-generating/) doi:10.24963/IJCAI.2020/466

BibTeX

@inproceedings{shen2020ijcai-generating,
  title     = {{Generating Behavior-Diverse Game AIs with Evolutionary Multi-Objective Deep Reinforcement Learning}},
  author    = {Shen, Ruimin and Zheng, Yan and Hao, Jianye and Meng, Zhaopeng and Chen, Yingfeng and Fan, Changjie and Liu, Yang},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2020},
  pages     = {3371-3377},
  doi       = {10.24963/IJCAI.2020/466},
  url       = {https://mlanthology.org/ijcai/2020/shen2020ijcai-generating/}
}