VRU Pose-SSD: Multiperson Pose Estimation for Automated Driving

Abstract

We present a fast and efficient approach for joint person detection and pose estimation optimized for automated driving (AD) in urban scenarios. We use a multitask weight sharing architecture to jointly train detection and pose estimation. This modular architecture allows us to accommodate different downstream tasks in the future. By systematic large-scale experiments on the Tsinghua-Daimler Urban Pose Dataset (TDUP), we obtain multiple models with varying accuracy-speed trade-offs. We then quantize and optimize our network for deployment and present a detailed analysis of the efficacy of the algorithm. We introduce a two-stage evaluation strategy, which is more suitable for AD and achieve a significant performance improvement in comparison to state-of-the-art approaches. Our optimized model runs at 52~fps on full HD images and still reaches a competitive performance of 32.25~LAMR. We are confident that our work serves as an enabler to tackle higher-level tasks like VRU intention estimation and gesture recognition, which rely on stable pose estimates and will play a crucial role in future AD systems.

Cite

Text

Kumar et al. "VRU Pose-SSD: Multiperson Pose Estimation for Automated Driving." AAAI Conference on Artificial Intelligence, 2021. doi:10.1609/AAAI.V35I17.17800

Markdown

[Kumar et al. "VRU Pose-SSD: Multiperson Pose Estimation for Automated Driving." AAAI Conference on Artificial Intelligence, 2021.](https://mlanthology.org/aaai/2021/kumar2021aaai-vru/) doi:10.1609/AAAI.V35I17.17800

BibTeX

@inproceedings{kumar2021aaai-vru,
  title     = {{VRU Pose-SSD: Multiperson Pose Estimation for Automated Driving}},
  author    = {Kumar, Chandan and Ramesh, Jayanth and Chakraborty, Bodhisattwa and Raman, Renjith and Weinrich, Christoph and Mundhada, Anurag and Jain, Arjun and Flohr, Fabian B.},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year      = {2021},
  pages     = {15331-15338},
  doi       = {10.1609/AAAI.V35I17.17800},
  url       = {https://mlanthology.org/aaai/2021/kumar2021aaai-vru/}
}