Open Media Forensics Challenge (OpenMFC) 2020-2021: Past, Present, and Future
Haiying Guan, Yooyoung Lee, Lukas Diduch, Jesse Zhang, Ilia Ghorbanian Bajgiran, Timothee Kheyrkhah, Peter Fontana, Jonathan G. Fiscus
This document describes the online leaderboard public evaluation program, Open Media Forensics Challenge (OpenMFC) 2021-2022. In the report, first, the introduction, objectives, challenges, contributions, and achievements of the evaluation program are covered and discussed in the Section 1. Second, the evaluation website, tasks, datasets, and the leaderboard interface are described in the Section 2. The participants' system performance results are also presented in this section. Third, the community engagements, findings, and public participants' difficulties are summarized in the Section 3. Then, two new studies for the next year evaluation, OpenMFC 2021-2022, are introduced in the same section. After that, the solutions to help public participants and the OpenMFC 2021-2022 work plan are proposed in the Section 4. Finally, the potential impacts are predicated in the Section 5. In the OpenMFC 2020-2021 evaluation, 56 participants registered the program, and 194 public researchers worldwide received MFC datasets. Since 2016, NIST has released MFC dataset to more than 500 individuals, 200 organizations, from 26 countries and regions worldwide.
Media Forensics, DARPA MediFor (Media Forensic) program, Media Forensic Challenge (MFC) Evaluation, Image Manipulation Detection and Localization (IMDL), Video Manipulation Detection (VMD), Image GAN Manipulation Detection (IGMD), Video GAN Manipulation Detection (VGMD), Deepfakes, and Steganography.
, Lee, Y.
, Diduch, L.
, Zhang, J.
, Ghorbanian Bajgiran, I.
, Kheyrkhah, T.
, Fontana, P.
and Fiscus, J.
Open Media Forensics Challenge (OpenMFC) 2020-2021: Past, Present, and Future, NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/NIST.IR.8396, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=933191
(Accessed August 19, 2022)