poster

Why Do Facial Deepfake Detectors Fail?

Authors:

Alsharif Abuadbba,

Kristen Moore, and

Simon WooAuthors Info & Claims

WDC '23: Proceedings of the 2nd Workshop on Security Implications of Deepfakes and Cheapfakes

July 2023

Pages 24 - 28

https://doi.org/10.1145/3595353.3595882

Published: 02 September 2023 Publication History

Abstract

Recent rapid advancements in deepfake technology have allowed the creation of highly realistic fake media, such as video, image, and audio. These materials pose significant challenges to human authentication, such as impersonation, misinformation, or even a threat to national security. To keep pace with these rapid advancements, several deepfake detection algorithms have been proposed, leading to an ongoing arms race between deepfake creators and deepfake detectors. Nevertheless, these detectors are often unreliable and frequently fail to detect deepfakes. This study highlights the challenges they face in detecting deepfakes, including (1) the pre-processing pipeline of artifacts and (2) the fact that generators of new, unseen deepfake samples have not been considered when building the defense models. Our work sheds light on the need for further research and development in this field to create more robust and reliable detectors.

References

[1]

Shruti Agarwal, Hany Farid, Tarek El-Gaaly, and Ser-Nam Lim. 2020. Detecting deep-fake videos from appearance and behavior. In 2020 IEEE international workshop on information forensics and security (WIFS). IEEE, 1–6.

[2]

Young Oh Bang and Simon S Woo. 2021. DA-FDFtNet: dual attention fake detection fine-tuning network to detect various AI-generated fake images. arXiv preprint arXiv:2112.12001 (2021).

[3]

DeepFakes Community. 2017. DeepFakes. https://github.com/deepfakes/faceswap. Accessed: 2021-01-01.

[4]

FaceSwap Community. 2016. FaceSwap. https://github.com/MarekKowalski/FaceSwap. Accessed: 2021-01-01.

[5]

Brian Dolhansky, Joanna Bitton, Ben Pflaum, Jikuo Lu, Russ Howes, Menglin Wang, and Cristian Canton Ferrer. 2020. The deepfake detection challenge (dfdc) dataset. arXiv preprint arXiv:2006.07397 (2020).

[6]

Ricard Durall, Margret Keuper, and Janis Keuper. 2020. Watch your up-convolution: Cnn based generative deep neural networks are failing to reproduce spectral distributions. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 7890–7899.

[7]

Minha Kim, Shahroz Tariq, and Simon S Woo. 2021. Cored: Generalizing fake media detection with continual representation using distillation. In Proceedings of the 29th ACM International Conference on Multimedia. 337–346.

Digital Library

[8]

Minha Kim, Shahroz Tariq, and Simon S Woo. 2021. Fretal: Generalizing deepfake detection using knowledge distillation and representation learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 1001–1012.

[9]

Davis E. King. 2009. Dlib-ml: A Machine Learning Toolkit. Journal of Machine Learning Research 10 (2009), 1755–1758.

Digital Library

[10]

Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).

[11]

Binh M Le and Simon S Woo. 2021. ADD: Frequency attention and multi-view based knowledge distillation to detect low-quality compressed deepfake images. arXiv preprint arXiv:2112.03553 (2021).

[12]

Binh M Le and Simon S Woo. 2021. Exploring the Asynchronous of the Frequency Spectra of GAN-generated Facial Images. arXiv preprint arXiv:2112.08050 (2021).

[13]

Sangyup Lee, Jaeju An, and Simon S Woo. 2022. BZNet: Unsupervised Multi-scale Branch Zooming Network for Detecting Low-quality Deepfake Videos. In Proceedings of the ACM Web Conference 2022. 3500–3510.

Digital Library

[14]

Sangyup Lee, Shahroz Tariq, Junyaup Kim, and Simon S Woo. 2021. Tar: Generalized forensic framework to detect deepfakes using weakly supervised learning. In ICT Systems Security and Privacy Protection: 36th IFIP TC 11 International Conference, SEC 2021, Oslo, Norway, June 22–24, 2021, Proceedings. Springer, 351–366.

[15]

Changjiang Li, Li Wang, Shouling Ji, Xuhong Zhang, Zhaohan Xi, Shanqing Guo, and Ting Wang. 2022. Seeing is living? rethinking the security of facial liveness verification in the deepfake era. In 31st USENIX Security Symposium (USENIX Security 22). 2673–2690.

[16]

Lingzhi Li, Jianmin Bao, Hao Yang, Dong Chen, and Fang Wen. 2019. Faceshifter: Towards high fidelity and occlusion aware face swapping. arXiv preprint arXiv:1912.13457 (2019).

[17]

Yuezun Li, Xin Yang, Pu Sun, Honggang Qi, and Siwei Lyu. 2020. Celeb-df: A large-scale challenging dataset for deepfake forensics. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 3207–3216.

[18]

Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu. 2017. Towards deep learning models resistant to adversarial attacks. arXiv preprint arXiv:1706.06083 (2017).

[19]

Yisroel Mirsky and Wenke Lee. 2021. The creation and detection of deepfakes: A survey. ACM Computing Surveys (CSUR) 54, 1 (2021), 1–41.

Digital Library

[20]

Lutz Prechelt. 1998. Early stopping-but when? In Neural Networks: Tricks of the trade. Springer, 55–69.

Digital Library

[21]

Andreas Rossler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, and Matthias Nießner. 2019. Faceforensics++: Learning to detect manipulated facial images. In Proceedings of the IEEE/CVF international conference on computer vision. 1–11.

[22]

Kaede Shiohara and Toshihiko Yamasaki. 2022. Detecting deepfakes with self-blended images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 18720–18729.

[23]

Leslie N Smith and Nicholay Topin. 2019. Super-convergence: Very fast training of neural networks using large learning rates. In Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications, Vol. 11006. International Society for Optics and Photonics, 1100612.

[24]

Shahroz Tariq, Sowon Jeon, and Simon S Woo. 2022. Am I a Real or Fake Celebrity? Evaluating Face Recognition and Verification APIs under Deepfake Impersonation Attack. In Proceedings of the ACM Web Conference 2022. 512–523.

Digital Library

[25]

Shahroz Tariq, Sangyup Lee, Hoyoung Kim, Youjin Shin, and Simon S Woo. 2019. Gan is a friend or foe? a framework to detect various fake face images. In Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing. 1296–1303.

Digital Library

[26]

Shahroz Tariq, Sangyup Lee, and Simon Woo. 2021. One detector to rule them all: Towards a general deepfake attack detection framework. In Proceedings of the web conference 2021. 3625–3637.

Digital Library

[27]

Justus Thies, Michael Zollhöfer, and Matthias Nießner. 2019. Deferred neural rendering: Image synthesis using neural textures. Acm Transactions on Graphics (TOG) 38, 4 (2019), 1–12.

Digital Library

[28]

Justus Thies, Michael Zollhofer, Marc Stamminger, Christian Theobalt, and Matthias Nießner. 2016. Face2face: Real-time face capture and reenactment of rgb videos. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2387–2395.

Digital Library

[29]

Chien-Yi Wang, Yu-Ding Lu, Shang-Ta Yang, and Shang-Hong Lai. 2022. PatchNet: A simple face anti-spoofing framework via fine-grained patch recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 20281–20290.

[30]

Mika Westerlund. 2019. The emergence of deepfake technology: A review. Technology innovation management review 9, 11 (2019).

[31]

Hanqing Zhao, Wenbo Zhou, Dongdong Chen, Tianyi Wei, Weiming Zhang, and Nenghai Yu. 2021. Multi-Attentional Deepfake Detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2185–2194.

Cited By

Łabuz MNehring C(2024) Information apocalypse or overblown fears—what AI mis‐ and disinformation is all about? Shifting away from technology toward human reactions Politics & Policy10.1111/polp.12617Online publication date: 6-Jun-2024
https://doi.org/10.1111/polp.12617
Montasari RMontasari R(2024)Responding to Deepfake Challenges in the United Kingdom: Legal and Technical Insights with RecommendationsCyberspace, Cyberterrorism and the International Security in the Fourth Industrial Revolution10.1007/978-3-031-50454-9_12(241-258)Online publication date: 19-Jan-2024
https://doi.org/10.1007/978-3-031-50454-9_12
Alanazi FUshaw GMorgan G(2023)Improving Detection of DeepFakes through Facial Region Analysis in ImagesElectronics10.3390/electronics1301012613:1(126)Online publication date: 28-Dec-2023
https://doi.org/10.3390/electronics13010126

Index Terms

Why Do Facial Deepfake Detectors Fail?
1. Security and privacy
  1. Security services

Recommendations

DEEPFAKER: A Unified Evaluation Platform for Facial Deepfake and Detection Models
Deepfake data contains realistically manipulated faces—its abuses pose a huge threat to the security and privacy-critical applications. Intensive research from academia and industry has produced many deepfake/detection models, leading to a constant race ...
Read More
Adversarial Attacks on Deepfake Detectors: A Practical Analysis
MultiMedia Modeling
Abstract
In this day and age, fake images can be easily generated using some of the state-of-the-art Generative Adversarial Networks (GANs), including Deepfake. These fake images, along with unfactual content, can pose a substantial threat to our society ...
Read More
Deepfake videos: synthesis and detection techniques – a survey

Deep learning has been used in computer vision to accomplish many tasks that were previously considered too complex or resource-intensive to be feasible. One remarkable application is the creation of deepfakes. Deepfake images change or manipulate a ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WDC '23: Proceedings of the 2nd Workshop on Security Implications of Deepfakes and Cheapfakes

July 2023

37 pages

ISBN:9798400702037

DOI:10.1145/3595353

Editors:
Simon S. Woo
Sungkyunkwan University, South Korea
,
Shahroz Tariq
CSIRO’s Data61, Australia
,
Sharif Abuadbba
CSIRO’s Data61, Australia
,
Kristen Moore
CSIRO’s Data61, Australia

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGSAC: ACM Special Interest Group on Security, Audit, and Control

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 September 2023

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

Artificial Intelligence Innovation Hub
Advanced and Proactive AI Platform Research and Development Against Malicious Deepfakes
AI Graduate School Support Program at Sungkyunkwan University
Self-directed Multi-Modal Intelligence for solving unknown, open domain problems
Graduate School of Convergence Security at Sungkyunkwan University
AI Platform to Fully Adapt and Reflect Privacy-Policy Changes

Conference

ASIA CCS '23

Sponsor:

SIGSAC

ASIA CCS '23: ACM Asia Conference on Computer and Communications Security

July 10 - 14, 2023

VIC, Melbourne, Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
135
Total Downloads

Downloads (Last 12 months)135
Downloads (Last 6 weeks)8

Other Metrics

View Author Metrics

Citations

Cited By

Łabuz MNehring C(2024) Information apocalypse or overblown fears—what AI mis‐ and disinformation is all about? Shifting away from technology toward human reactions Politics & Policy10.1111/polp.12617Online publication date: 6-Jun-2024
https://doi.org/10.1111/polp.12617
Montasari RMontasari R(2024)Responding to Deepfake Challenges in the United Kingdom: Legal and Technical Insights with RecommendationsCyberspace, Cyberterrorism and the International Security in the Fourth Industrial Revolution10.1007/978-3-031-50454-9_12(241-258)Online publication date: 19-Jan-2024
https://doi.org/10.1007/978-3-031-50454-9_12
Alanazi FUshaw GMorgan G(2023)Improving Detection of DeepFakes through Facial Region Analysis in ImagesElectronics10.3390/electronics1301012613:1(126)Online publication date: 28-Dec-2023
https://doi.org/10.3390/electronics13010126

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents