Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Open Media Forensics Challenge (OpenMFC) 2020-2021: Past, Present, and Future

Published

Author(s)

Haiying Guan, Yooyoung Lee, Lukas Diduch, Jesse Zhang, Ilia Ghorbanian Bajgiran, Timothee Kheyrkhah, Peter Fontana, Jonathan G. Fiscus

Abstract

This document describes the online leaderboard public evaluation program, Open Media Forensics Challenge (OpenMFC) 2021-2022. In the report, first, the introduction, objectives, challenges, contributions, and achievements of the evaluation program are covered and discussed in the Section 1. Second, the evaluation website, tasks, datasets, and the leaderboard interface are described in the Section 2. The participants' system performance results are also presented in this section. Third, the community engagements, findings, and public participants' difficulties are summarized in the Section 3. Then, two new studies for the next year evaluation, OpenMFC 2021-2022, are introduced in the same section. After that, the solutions to help public participants and the OpenMFC 2021-2022 work plan are proposed in the Section 4. Finally, the potential impacts are predicated in the Section 5. In the OpenMFC 2020-2021 evaluation, 56 participants registered the program, and 194 public researchers worldwide received MFC datasets. Since 2016, NIST has released MFC dataset to more than 500 individuals, 200 organizations, from 26 countries and regions worldwide.
Citation
NIST Interagency/Internal Report (NISTIR) - 8396
Report Number
8396

Keywords

Media Forensics, DARPA MediFor (Media Forensic) program, Media Forensic Challenge (MFC) Evaluation, Image Manipulation Detection and Localization (IMDL), Video Manipulation Detection (VMD), Image GAN Manipulation Detection (IGMD), Video GAN Manipulation Detection (VGMD), Deepfakes, and Steganography.

Citation

Guan, H. , Lee, Y. , Diduch, L. , Zhang, J. , Ghorbanian Bajgiran, I. , Kheyrkhah, T. , Fontana, P. and Fiscus, J. (2021), Open Media Forensics Challenge (OpenMFC) 2020-2021: Past, Present, and Future, NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/NIST.IR.8396, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=933191 (Accessed November 30, 2021)
Created September 29, 2021