Skip to main content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Media Forensics Challenge Evaluation Overview Talk on ARO Sponsored Workshop on Assured Autonomy

Published

Author(s)

Haiying Guan, Jonathan G. Fiscus

Abstract

The Media Forensics Challenge (MFC) Evaluation is a series of annual evaluations NIST administered to support the evaluation needs of the DARPA MediFor Program from 2016-2020. The objective of MFC is to support the development of media forensic technologies – technologies that determine the region and type of manipulations in imagery (image/video data) and the phylogenic process that modified the imagery. In this talk, we will discuss the MFC evaluation design that supported a diverse set of research directions as well as our approach to evaluating systems capable of determining when a system response should be given. We present MFC evaluation schema, which includes evaluation tasks, datasets, metrics and software, and infrastructure. We also present the evaluation results and provide NIST MFC resources. The MFC “Opt-In” evaluation paradigm that sought to not penalize systems for declining to respond may be a potential performance evaluation technique for assured autonomy.

Keywords

Media Forensics Challenge (MFC), Evaluation Design, Assured Autonomy, Image Manipulation Detection
Created June 24, 2020, Updated June 26, 2020