Guan, H.
and , J.
(2020),
Media Forensics Challenge Evaluation Overview Talk on ARO Sponsored Workshop on Assured Autonomy, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=930628
(Accessed January 29, 2022)
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
Media Forensics Challenge Evaluation Overview Talk on ARO Sponsored Workshop on Assured Autonomy
Published
Author(s)
,
Abstract
The Media Forensics Challenge (MFC) Evaluation is a series of annual evaluations NIST administered to support the evaluation needs of the DARPA MediFor Program from 2016-2020. The objective of MFC is to support the development of media forensic technologies - technologies that determine the region and type of manipulations in imagery (image/video data) and the phylogenic process that modified the imagery. In this talk, we will discuss the MFC evaluation design that supported a diverse set of research directions as well as our approach to evaluating systems capable of determining when a system response should be given. We present MFC evaluation schema, which includes evaluation tasks, datasets, metrics and software, and infrastructure. We also present the evaluation results and provide NIST MFC resources. The MFC "Opt-In" evaluation paradigm that sought to not penalize systems for declining to respond may be a potential performance evaluation technique for assured autonomy.Pub Type
Talks
Download Paper
Keywords
Media Forensics Challenge (MFC), Evaluation Design, Assured Autonomy, Image Manipulation Detection
Citation
Created June 23, 2020, Updated June 24, 2021