Deepfakes Detection with Automatic Face Weighting

Daniel Mas Montserrat, Hanxiang Hao, Sri Kalyan Yarlagadda, Sriram Baireddy, Ruiting Shao, János Horváth, Emily R. Bartusiak, Justin Yang, David Güera, Fengqing Zhu, Edward J. Delp

CVPRW 2020 pp. 2851-2859

doi:10.1109/CVPRW50498.2020.00342 /cvprw/2020/montserrat2020cvprw-deepfakes/

Abstract

Altered and manipulated multimedia is increasingly present and widely distributed via social media platforms. Advanced video manipulation tools enable the generation of highly realistic-looking altered multimedia. While many methods have been presented to detect manipulations, most of them fail when evaluated with data outside of the datasets used in research environments. In order to address this problem, the Deepfake Detection Challenge (DFDC) provides a large dataset of videos containing realistic manipulations and an evaluation system that ensures that methods work quickly and accurately, even when faced with challenging data. In this paper, we introduce a method based on convolutional neural networks (CNNs) and recurrent neural networks (RNNs) that extracts visual and temporal features from faces present in videos to accurately detect manipulations. The method is evaluated with the DFDC dataset, providing competitive results compared to other techniques.

PDF CVPRW Semantic Scholar

Cite

Text

Montserrat et al. "Deepfakes Detection with Automatic Face Weighting." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020. doi:10.1109/CVPRW50498.2020.00342

Markdown

[Montserrat et al. "Deepfakes Detection with Automatic Face Weighting." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020.](https://mlanthology.org/cvprw/2020/montserrat2020cvprw-deepfakes/) doi:10.1109/CVPRW50498.2020.00342

BibTeX

@inproceedings{montserrat2020cvprw-deepfakes,
  title     = {{Deepfakes Detection with Automatic Face Weighting}},
  author    = {Montserrat, Daniel Mas and Hao, Hanxiang and Yarlagadda, Sri Kalyan and Baireddy, Sriram and Shao, Ruiting and Horváth, János and Bartusiak, Emily R. and Yang, Justin and Güera, David and Zhu, Fengqing and Delp, Edward J.},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2020},
  pages     = {2851-2859},
  doi       = {10.1109/CVPRW50498.2020.00342},
  url       = {https://mlanthology.org/cvprw/2020/montserrat2020cvprw-deepfakes/}
}