Automatic Facial Expression Recognition for Intelligent Tutoring Systems

Abstract

This project explores the idea of facial expression for automated feedback in teaching. We show how automatic realtime facial expression recognition can be effectively used to estimate the difficulty level, as perceived by an individual student, of a delivered lecture. We also show that facial expression is predictive of an individual studentpsilas preferred rate of curriculum presentation at each moment in time. On a video lecture viewing task, training on less than two minutes of recorded facial expression data and testing on a separate validation set, our system predicted the subjectspsila self-reported difficulty scores with mean accuracy of 0:42 (Pearson R) and their preferred viewing speeds with mean accuracy of 0:29. Our techniques are fully automatic and have potential applications for both intelligent tutoring systems (ITS) and standard classroom environments.

Cite

Text

Whitehill et al. "Automatic Facial Expression Recognition for Intelligent Tutoring Systems." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2008. doi:10.1109/CVPRW.2008.4563182

Markdown

[Whitehill et al. "Automatic Facial Expression Recognition for Intelligent Tutoring Systems." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2008.](https://mlanthology.org/cvprw/2008/whitehill2008cvprw-automatic/) doi:10.1109/CVPRW.2008.4563182

BibTeX

@inproceedings{whitehill2008cvprw-automatic,
  title     = {{Automatic Facial Expression Recognition for Intelligent Tutoring Systems}},
  author    = {Whitehill, Jacob and Bartlett, Marian Stewart and Movellan, Javier R.},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2008},
  pages     = {1-6},
  doi       = {10.1109/CVPRW.2008.4563182},
  url       = {https://mlanthology.org/cvprw/2008/whitehill2008cvprw-automatic/}
}