Non-Contact Heart Rate Monitoring by Combining Convolutional Neural Network Skin Detection and Remote Photoplethysmography via a Low-Cost Camera

Abstract

In this paper, we present a versatile methodology to accomplish the non-contact monitoring of heart rate signals in unconstrained environments, by combining the convolutional neural network (CNN) skin detection and the camera-based remote photoplethysmography (rPPG) methods. Compared to the widely-used three-step skin detection method (i.e., face detection, face tracking, and skin classification), the CNN method used here could enhance the monitoring robustness by achieving the skin detection in a single step. The proposed CNN-rPPG method has been tested in an unconstrained office environment to validate its applicability. Combined with the subsequent rPPG heart rate monitoring based on a low-cost camera, the method presented here is of practical interests for the large-scale deployment of the non-contact heart rate monitoring technologies.

Cite

Text

Tang et al. "Non-Contact Heart Rate Monitoring by Combining Convolutional Neural Network Skin Detection and Remote Photoplethysmography via a Low-Cost Camera." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2018. doi:10.1109/CVPRW.2018.00178

Markdown

[Tang et al. "Non-Contact Heart Rate Monitoring by Combining Convolutional Neural Network Skin Detection and Remote Photoplethysmography via a Low-Cost Camera." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2018.](https://mlanthology.org/cvprw/2018/tang2018cvprw-noncontact/) doi:10.1109/CVPRW.2018.00178

BibTeX

@inproceedings{tang2018cvprw-noncontact,
  title     = {{Non-Contact Heart Rate Monitoring by Combining Convolutional Neural Network Skin Detection and Remote Photoplethysmography via a Low-Cost Camera}},
  author    = {Tang, Chuanxiang and Lu, Jiwu and Liu, Jie},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2018},
  pages     = {1309-1315},
  doi       = {10.1109/CVPRW.2018.00178},
  url       = {https://mlanthology.org/cvprw/2018/tang2018cvprw-noncontact/}
}