SMARTS: An Open-Source Scalable Multi-Agent RL Training School for Autonomous Driving
Abstract
Interaction is fundamental in autonomous driving (AD). Despite more than a decade of intensive R&D in AD, how to dynamically interact with diverse road users in various contexts still remains unsolved. Multi-agent learning has recently seen big breakthroughs and has much to offer towards solving realistic interaction in AD. However, to realize this potential we need multi-agent AD simulation of realistic interaction. To break this apparent chicken-and-egg circularity, we built an AD simulation platform called SMARTS (Scalable Multi-Agent Rl Training School), which is designed to accumulate behavior models of road users towards increasingly realistic and diverse interaction that in turn enables deeper and broader multi-agent research on interaction. In this paper, we describe the design goals of SMARTS, explain its key architectural ideas, illustrate its use for multi-agent research through experiments on concrete interaction scenarios, and introduce a set of benchmarks and metrics. As an open-source, industrial-strength platform, the future of SMARTS lies in its growth along with the multi-agent research it enables in the years to come.
Cite
Text
Zhou et al. "SMARTS: An Open-Source Scalable Multi-Agent RL Training School for Autonomous Driving." Conference on Robot Learning, 2020.Markdown
[Zhou et al. "SMARTS: An Open-Source Scalable Multi-Agent RL Training School for Autonomous Driving." Conference on Robot Learning, 2020.](https://mlanthology.org/corl/2020/zhou2020corl-smarts/)BibTeX
@inproceedings{zhou2020corl-smarts,
title = {{SMARTS: An Open-Source Scalable Multi-Agent RL Training School for Autonomous Driving}},
author = {Zhou, Ming and Luo, Jun and Villella, Julian and Yang, Yaodong and Rusu, David and Miao, Jiayu and Zhang, Weinan and Alban, Montgomery and Fadakar, Iman and Chen, Zheng and Huang, Chongxi and Wen, Ying and Hassanzadeh, Kimia and Graves, Daniel and Zhu, Zhengbang and Ni, Yihan and Nguyen, Nhat and Elsayed, Mohamed and Ammar, Haitham and Cowen-Rivers, Alexander and Ahilan, Sanjeevan and Tian, Zheng and Palenicek, Daniel and Rezaee, Kasra and Yadmellat, Peyman and Shao, Kun and Chen, Dong and Zhang, Baokuan and Zhang, Hongbo and Hao, Jianye and Liu, Wulong and Wang, Jun},
booktitle = {Conference on Robot Learning},
year = {2020},
pages = {264-285},
volume = {155},
url = {https://mlanthology.org/corl/2020/zhou2020corl-smarts/}
}