Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Abstract
High quality face editing in videos is a growing concern and spreads distrust in video content. However, upon closer examination, many face editing algorithms exhibit artifacts that resemble classical computer vision issues that stem from face tracking and editing. As a consequence, we wonder how difficult it is to expose artificial faces from current generators? To this end, we review current facial editing methods and several characteristic artifacts from their processin pipelines. We also show that relatively simple visual artifacts can be already quite effective in exposing such manipulations, including Deepfakes and Face2Face. Since the methods are based on visual features, they are easily explicable also to non-technical experts. The methods are easy to implement and offer capabilities for rapid adjustment to new manipulation types with little data available. Despite their simplicity, the methods are able to achieve AUC values of up to 0.866.
Cite
Text
Matern et al. "Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations." IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, 2019. doi:10.1109/WACVW.2019.00020Markdown
[Matern et al. "Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations." IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, 2019.](https://mlanthology.org/wacvw/2019/matern2019wacvw-exploiting/) doi:10.1109/WACVW.2019.00020BibTeX
@inproceedings{matern2019wacvw-exploiting,
title = {{Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations}},
author = {Matern, Falko and Riess, Christian and Stamminger, Marc},
booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision Workshops},
year = {2019},
pages = {83-92},
doi = {10.1109/WACVW.2019.00020},
url = {https://mlanthology.org/wacvw/2019/matern2019wacvw-exploiting/}
}