A Camera-Based System to Detect Driver Hands on the Steering Wheel in Semi-Autonomous Vehicles
Abstract
Semi-autonomous vehicles require monitoring the driver to check if he is supervising the system and/or ready to take over. Most cars rely on steering-wheel sensors to detect hands and do not monitor the non-driving related task the driver might be performing. We present a camera-based system with a multi-branch architecture, which provides the number of hands on the steering wheel, on a tablet representing a secondary task and the tablet position. It also tackles a common issue with other camera-based systems: a free hand in front of the steering wheel can be classified as grasping it. Moreover, our system deals with cases when the driver might use a tablet on the steering wheel, as he is allowed to do in autonomous mode. These two points are critical to assess the time the driver will need to take over. Finally, combining both steering wheel and camera systems would also make vehicles harder to trick and therefore safer. Video available at: https://www.youtube.com/watch?v=qfYOM4sdWr4
Cite
Text
Morvillier et al. "A Camera-Based System to Detect Driver Hands on the Steering Wheel in Semi-Autonomous Vehicles." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2022. doi:10.1007/978-3-031-26422-1_42Markdown
[Morvillier et al. "A Camera-Based System to Detect Driver Hands on the Steering Wheel in Semi-Autonomous Vehicles." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2022.](https://mlanthology.org/ecmlpkdd/2022/morvillier2022ecmlpkdd-camerabased/) doi:10.1007/978-3-031-26422-1_42BibTeX
@inproceedings{morvillier2022ecmlpkdd-camerabased,
title = {{A Camera-Based System to Detect Driver Hands on the Steering Wheel in Semi-Autonomous Vehicles}},
author = {Morvillier, Raphaël and Prat, Christophe and Aloui, Saifeddine},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2022},
pages = {617-621},
doi = {10.1007/978-3-031-26422-1_42},
url = {https://mlanthology.org/ecmlpkdd/2022/morvillier2022ecmlpkdd-camerabased/}
}