The Waymo Open Sim Agents Challenge
Abstract
Simulation with realistic, interactive agents represents a key task for autonomous vehicle software development. In this work, we introduce the Waymo Open Sim Agents Challenge (WOSAC). WOSAC is the first public challenge to tackle this task and propose corresponding metrics. The goal of the challenge is to stimulate the design of realistic simulators that can be used to evaluate and train a behavior model for autonomous driving. We outline our evaluation methodology, present results for a number of different baseline simulation agent methods, and analyze several submissions to the 2023 competition which ran from March 16, 2023 to May 23, 2023. The WOSAC evaluation server remains open for submissions and we discuss open problems for the task.
Cite
Text
Montali et al. "The Waymo Open Sim Agents Challenge." Neural Information Processing Systems, 2023.Markdown
[Montali et al. "The Waymo Open Sim Agents Challenge." Neural Information Processing Systems, 2023.](https://mlanthology.org/neurips/2023/montali2023neurips-waymo/)BibTeX
@inproceedings{montali2023neurips-waymo,
title = {{The Waymo Open Sim Agents Challenge}},
author = {Montali, Nico and Lambert, John and Mougin, Paul and Kuefler, Alex and Rhinehart, Nicholas and Li, Michelle and Gulino, Cole and Emrich, Tristan and Yang, Zoey and Whiteson, Shimon and White, Brandyn and Anguelov, Dragomir},
booktitle = {Neural Information Processing Systems},
year = {2023},
url = {https://mlanthology.org/neurips/2023/montali2023neurips-waymo/}
}