Open Media Forensics Challenge (OpenMFC) 2020-2021: Past, Present, and Future

Published

September 29, 2021

Author(s)

Haiying Guan, Yooyoung Lee, Lukas Diduch, Jesse Zhang, Ilia Ghorbanian Bajgiran, Timothee Kheyrkhah, Peter Fontana, Jonathan G. Fiscus

Abstract

This document describes the online leaderboard public evaluation program, Open Media Forensics Challenge (OpenMFC) 2021-2022. In the report, first, the introduction, objectives, challenges, contributions, and achievements of the evaluation program are covered and discussed in the Section 1. Second, the evaluation website, tasks, datasets, and the leaderboard interface are described in the Section 2. The participants' system performance results are also presented in this section. Third, the community engagements, findings, and public participants' difficulties are summarized in the Section 3. Then, two new studies for the next year evaluation, OpenMFC 2021-2022, are introduced in the same section. After that, the solutions to help public participants and the OpenMFC 2021-2022 work plan are proposed in the Section 4. Finally, the potential impacts are predicated in the Section 5. In the OpenMFC 2020-2021 evaluation, 56 participants registered the program, and 194 public researchers worldwide received MFC datasets. Since 2016, NIST has released MFC dataset to more than 500 individuals, 200 organizations, from 26 countries and regions worldwide.

Citation

NIST Interagency/Internal Report (NISTIR) - 8396

Report Number

8396

NIST Pub Series

NIST Interagency/Internal Report (NISTIR)

Pub Type

NIST Pubs

Download Paper

https://doi.org/10.6028/NIST.IR.8396

Local Download

Keywords

Media Forensics, DARPA MediFor (Media Forensic) program, Media Forensic Challenge (MFC) Evaluation, Image Manipulation Detection and Localization (IMDL), Video Manipulation Detection (VMD), Image GAN Manipulation Detection (IGMD), Video GAN Manipulation Detection (VGMD), Deepfakes, and Steganography.

Citation

Guan, H. , Lee, Y. , Diduch, L. , Zhang, J. , Ghorbanian Bajgiran, I. , Kheyrkhah, T. , Fontana, P. and Fiscus, J. (2021), Open Media Forensics Challenge (OpenMFC) 2020-2021: Past, Present, and Future, NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/NIST.IR.8396, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=933191 (Accessed April 26, 2024)