CliffPhys: Camera-Based Respiratory Measurement Using Clifford Neural Networks
Abstract
This paper presents CliffPhys, a family of models that leverage hypercomplex neural architectures for camera-based respiratory measurement. The proposed approach extracts respiratory motion from standard RGB cameras, relying on optical flow and monocular depth estimation to obtain a 2D vector field and a scalar field, respectively. We show how the adoption of Clifford Neural Layers to model the geometric relationships within the recovered input fields allows respiratory information to be effectively estimated. Experimental results on three publicly available datasets demonstrate CliffPhys’ superior performance compared to both baselines and recent neural approaches, achieving state-of-the-art results in the prediction of respiratory rates. Source code available at: https: //github.com/phuselab/CliffPhys.
Cite
Text
Ghezzi et al. "CliffPhys: Camera-Based Respiratory Measurement Using Clifford Neural Networks." Proceedings of the European Conference on Computer Vision (ECCV), 2024. doi:10.1007/978-3-031-73013-9_13Markdown
[Ghezzi et al. "CliffPhys: Camera-Based Respiratory Measurement Using Clifford Neural Networks." Proceedings of the European Conference on Computer Vision (ECCV), 2024.](https://mlanthology.org/eccv/2024/ghezzi2024eccv-cliffphys/) doi:10.1007/978-3-031-73013-9_13BibTeX
@inproceedings{ghezzi2024eccv-cliffphys,
title = {{CliffPhys: Camera-Based Respiratory Measurement Using Clifford Neural Networks}},
author = {Ghezzi, Omar and Boccignone, Giuseppe and Grossi, Giuliano and Lanzarotti, Raffaella and D'Amelio, Alessandro},
booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
year = {2024},
doi = {10.1007/978-3-031-73013-9_13},
url = {https://mlanthology.org/eccv/2024/ghezzi2024eccv-cliffphys/}
}