Testing the Safety of Self-Driving Vehicles by Simulating Perception and Prediction
Abstract
We present a novel method for testing the safety of self-driving vehicles in simulation. We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. Instead, we directly simulate the outputs of the self-driving vehicle’s perception and prediction system, enabling realistic motion planning testing. Specifically, we use paired data in the form of ground truth labels and real perception and prediction outputs to train a model that predicts what the online system will produce. Importantly, the inputs to our system consists of high definition maps, bounding boxes, and trajectories, which can be easily sketched by a test engineer in a matter of minutes. This makes our approach a much more scalable solution. Quantitative results on two large-scale datasets demonstrate that we can realistically test motion planning using our simulations
Cite
Text
Wong et al. "Testing the Safety of Self-Driving Vehicles by Simulating Perception and Prediction." Proceedings of the European Conference on Computer Vision (ECCV), 2020. doi:10.1007/978-3-030-58574-7_19Markdown
[Wong et al. "Testing the Safety of Self-Driving Vehicles by Simulating Perception and Prediction." Proceedings of the European Conference on Computer Vision (ECCV), 2020.](https://mlanthology.org/eccv/2020/wong2020eccv-testing/) doi:10.1007/978-3-030-58574-7_19BibTeX
@inproceedings{wong2020eccv-testing,
title = {{Testing the Safety of Self-Driving Vehicles by Simulating Perception and Prediction}},
author = {Wong, Kelvin and Zhang, Qiang and Liang, Ming and Yang, Bin and Liao, Renjie and Sadat, Abbas and Urtasun, Raquel},
booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
year = {2020},
doi = {10.1007/978-3-030-58574-7_19},
url = {https://mlanthology.org/eccv/2020/wong2020eccv-testing/}
}