Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Identifying Face Quality and Factor Measures for Video

Published

Author(s)

Yooyoung Lee, P. Jonathon Phillips, James J. Filliben, J. R. Beveridge, Hao Zhang

Abstract

This paper identifies important factors for face recognition algorithm performance in video. The goal of this study is to understand key factors that affect algorithm performance and to characterize the algorithm performance. We evaluate four factor metrics for a single video as well as two comparative metrics for pairs of videos. This study carried out an investigation of the effect of nine factors on three algorithms using the Point-and-Shoot Challenge (PaSC) video dataset. These factors can be categorized into three groups: 1) image/video (pose yaw, pose roll, face size, and face detection confidence), 2) environment (environmental condition with person's activity and sensor model), and 3) subject (subject ID, gender, and race). For video-based face recognition, the analysis shows that the distribution-based methods were generally more effective in quantifying factor values. For predicting face recognition performance in a video, we observed that face detection confidence and face size serve as potentially useful quality measure metrics. We also find that males are easier to identify a face than females, and Asians are easier than Caucasians. Further, on the PaSC video dataset, the performance of face recognition algorithms are primarily driven by environment and sensor factors.
Citation
NIST Interagency/Internal Report (NISTIR) - 8004
Report Number
8004

Keywords

face recognition, sensitivity analysis, covariate or factor analysis, biometrics, forensics, video surveillance

Citation

Lee, Y. , Phillips, P. , Filliben, J. , Beveridge, J. and Zhang, H. (2014), Identifying Face Quality and Factor Measures for Video, NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/NIST.IR.8004, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=915501 (Accessed November 29, 2022)
Created May 20, 2014, Updated October 14, 2021