Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

2018 Media Forensics Challenges (MFC18): Summary and Results



Yooyoung Lee, Amy Yates, Haiying Guan, Jonathan G. Fiscus, Daniel Zhou


The interest of forensic techniques capable of detecting many different manipulation types has been growing, and system developments with machine learning technology have been evolving in recent years. There has been, however, a lack of diverse data collection and evaluation studies for advancing multimedia forensics technologies. For the forensics research community, a well-defined evaluation is necessary to rapidly examine the performance of system's accuracy and robustness over diverse datasets collected under various environments. In this paper, we propose an evaluation protocol and associated performance metrics and apply them to the 2018 Multimedia Forensics Challenge (MFC18). The MFC18 evaluation consists of five tasks and two challenges. A large number of datasets were created for supporting each task and conducting experiments for comparative analysis using a structured evaluation protocol. In summary, a total of 25 teams participated in the MFC18 evaluation, and we provide a ranked list of systems based on their performance with respect to the MFC18 five tasks and the two challenges.
NIST Interagency/Internal Report (NISTIR) - 8324
Report Number


Media forensics, forensics, evaluation


Lee, Y. , Yates, A. , Guan, H. , Fiscus, J. and Zhou, D. (2020), 2018 Media Forensics Challenges (MFC18): Summary and Results, NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online],, (Accessed May 19, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created November 12, 2020, Updated April 10, 2024