Skip to main content
U.S. flag

An official website of the United States government

Dot gov

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Https

Secure .gov websites use HTTPS
A lock ( ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Media Forensics Challenge Evaluation Overview Talk on ARO Sponsored Workshop on Assured Autonomy

Published

Author(s)

Haiying Guan, Jonathan G. Fiscus

Abstract

The Media Forensics Challenge (MFC) Evaluation is a series of annual evaluations NIST administered to support the evaluation needs of the DARPA MediFor Program from 2016-2020. The objective of MFC is to support the development of media forensic technologies – technologies that determine the region and type of manipulations in imagery (image/video data) and the phylogenic process that modified the imagery. In this talk, we will discuss the MFC evaluation design that supported a diverse set of research directions as well as our approach to evaluating systems capable of determining when a system response should be given. We present MFC evaluation schema, which includes evaluation tasks, datasets, metrics and software, and infrastructure. We also present the evaluation results and provide NIST MFC resources. The MFC “Opt-In” evaluation paradigm that sought to not penalize systems for declining to respond may be a potential performance evaluation technique for assured autonomy.

Keywords

Media Forensics Challenge (MFC), Evaluation Design, Assured Autonomy, Image Manipulation Detection
Created June 24, 2020, Updated June 26, 2020