Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Evaluation Infrastructure for the Measurement of Content-based Video Quality and Video Analytics Performance



Haiying Guan, Daniel F. Zhou, Jonathan G. Fiscus, John S. Garofolo, James M. Horan


In this report we describe a novel framework for evaluation of video analytics which uses video quality metric prediction as a measurement of the system performance. This system is used to improve overall video analytics system performance. The primary concept of this approach is to create an evaluation infrastructure that can promote the study of video quality metrics, and at the same time promote the research of video analytics. The achievements in both domains will have significant impacts on many application areas, such as public safety, homeland security, video surveillance applications, geographic applications and entertainment video.
NIST Interagency/Internal Report (NISTIR) - 8187
Report Number


Video Quality Metric (VQM), Video Analytics (VA), Multimedia Event Detection (MED), TREC Video Retrieval Evaluation (TRECVID), Point and Shoot Face Recognition Challenge (PaSC), Face Recognition, Detection Analysis Pipeline Resources (DAPR), Scorer-centric Evaluation, Analysis- Centric Evaluation, National Imagery Interpretability Rating Scale (NIIRS), Video-National Imagery Interpretability Rating Scale (VNIIRS), Mean opinion score (MOS), Difference Mean opinion score (DMOS).


Guan, H. , Zhou, D. , Fiscus, J. , Garofolo, J. and Horan, J. (2017), Evaluation Infrastructure for the Measurement of Content-based Video Quality and Video Analytics Performance, NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online], (Accessed July 14, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created July 30, 2017, Updated October 12, 2021