Towards End-to-End Video-Based Eye-Tracking

Seonwook Park, Emre Aksan, Xucong Zhang, Otmar Hilliges

ECCV 2020

doi:10.1007/978-3-030-58610-2_44 /eccv/2020/park2020eccv-endtoend/

Abstract

Estimating eye-gaze from images alone is a challenging task, in large parts due to un-observable person-specific factors. Achieving high accuracy typically requires labeled data from test users which may not be attainable in real applications. We observe that there exists a strong relationship between what users are looking at and the appearance of the user’s eyes. In response to this understanding, we propose a novel dataset and accompanying method which aims to explicitly learn these semantic and temporal relationships. Our video dataset consists of time-synchronized screen recordings, user-facing camera views, and eye gaze data, which allows for new benchmarks in temporal gaze tracking as well as label-free refinement of gaze. Importantly, we demonstrate that the fusion of information from visual stimuli as well as eye images can lead towards achieving performance similar to literature-reported figures acquired through supervised personalization. Our final method yields significant performance improvements on our proposed EVE dataset, with up to 28% improvement in Point-of-Gaze estimates (resulting in 2.49-deg in angular error), paving the path towards high-accuracy screen-based eye tracking purely from webcam sensors. The dataset and reference source code are available at https://ait.ethz.ch/projects/2020/EVE

PDF ECCV Semantic Scholar

Cite

Text

Park et al. "Towards End-to-End Video-Based Eye-Tracking." Proceedings of the European Conference on Computer Vision (ECCV), 2020. doi:10.1007/978-3-030-58610-2_44

Markdown

[Park et al. "Towards End-to-End Video-Based Eye-Tracking." Proceedings of the European Conference on Computer Vision (ECCV), 2020.](https://mlanthology.org/eccv/2020/park2020eccv-endtoend/) doi:10.1007/978-3-030-58610-2_44

BibTeX

@inproceedings{park2020eccv-endtoend,
  title     = {{Towards End-to-End Video-Based Eye-Tracking}},
  author    = {Park, Seonwook and Aksan, Emre and Zhang, Xucong and Hilliges, Otmar},
  booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
  year      = {2020},
  doi       = {10.1007/978-3-030-58610-2_44},
  url       = {https://mlanthology.org/eccv/2020/park2020eccv-endtoend/}
}