EyeNet: A Multi-Task Deep Network for Off-Axis Eye Gaze Estimation

Zhengyang Wu, Srivignesh Rajendran, Tarrence van As, Vijay Badrinarayanan, Andrew Rabinovich

ICCVW 2019 pp. 3683-3687

doi:10.1109/ICCVW.2019.00455 /iccvw/2019/wu2019iccvw-eyenet/

Abstract

Eye gaze estimation is a crucial component in Virtual and Mixed Reality. In head-mounted VR/MR devices the eyes are imaged off-axis to avoid blocking the user's gaze, this view-point makes drawing eye related inferences very challenging. In this work, we present EyeNet, the first single deep neural network which solves multiple heterogeneous tasks related to eye gaze estimation for an off-axis camera setting. The tasks include eye segmentation, IR LED glints detection, pupil and cornea center estimation. We benchmark all tasks on MagicEyes, a large and new dataset of 587 subjects with varying morphology, gender, skin-color, make-up and imaging conditions.

ICCVW Semantic Scholar

Cite

Text

Wu et al. "EyeNet: A Multi-Task Deep Network for Off-Axis Eye Gaze Estimation." IEEE/CVF International Conference on Computer Vision Workshops, 2019. doi:10.1109/ICCVW.2019.00455

Markdown

[Wu et al. "EyeNet: A Multi-Task Deep Network for Off-Axis Eye Gaze Estimation." IEEE/CVF International Conference on Computer Vision Workshops, 2019.](https://mlanthology.org/iccvw/2019/wu2019iccvw-eyenet/) doi:10.1109/ICCVW.2019.00455

BibTeX

@inproceedings{wu2019iccvw-eyenet,
  title     = {{EyeNet: A Multi-Task Deep Network for Off-Axis Eye Gaze Estimation}},
  author    = {Wu, Zhengyang and Rajendran, Srivignesh and van As, Tarrence and Badrinarayanan, Vijay and Rabinovich, Andrew},
  booktitle = {IEEE/CVF International Conference on Computer Vision Workshops},
  year      = {2019},
  pages     = {3683-3687},
  doi       = {10.1109/ICCVW.2019.00455},
  url       = {https://mlanthology.org/iccvw/2019/wu2019iccvw-eyenet/}
}