Non-Contact Heart Rate Monitoring by Combining Convolutional Neural Network Skin Detection and Remote Photoplethysmography via a Low-Cost Camera
Abstract
In this paper, we present a versatile methodology to accomplish the non-contact monitoring of heart rate signals in unconstrained environments, by combining the convolutional neural network (CNN) skin detection and the camera-based remote photoplethysmography (rPPG) methods. Compared to the widely-used three-step skin detection method (i.e., face detection, face tracking, and skin classification), the CNN method used here could enhance the monitoring robustness by achieving the skin detection in a single step. The proposed CNN-rPPG method has been tested in an unconstrained office environment to validate its applicability. Combined with the subsequent rPPG heart rate monitoring based on a low-cost camera, the method presented here is of practical interests for the large-scale deployment of the non-contact heart rate monitoring technologies.
Cite
Text
Tang et al. "Non-Contact Heart Rate Monitoring by Combining Convolutional Neural Network Skin Detection and Remote Photoplethysmography via a Low-Cost Camera." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2018. doi:10.1109/CVPRW.2018.00178Markdown
[Tang et al. "Non-Contact Heart Rate Monitoring by Combining Convolutional Neural Network Skin Detection and Remote Photoplethysmography via a Low-Cost Camera." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2018.](https://mlanthology.org/cvprw/2018/tang2018cvprw-noncontact/) doi:10.1109/CVPRW.2018.00178BibTeX
@inproceedings{tang2018cvprw-noncontact,
title = {{Non-Contact Heart Rate Monitoring by Combining Convolutional Neural Network Skin Detection and Remote Photoplethysmography via a Low-Cost Camera}},
author = {Tang, Chuanxiang and Lu, Jiwu and Liu, Jie},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
year = {2018},
pages = {1309-1315},
doi = {10.1109/CVPRW.2018.00178},
url = {https://mlanthology.org/cvprw/2018/tang2018cvprw-noncontact/}
}