Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Generalizing Face Quality and Factor Measures to Video

Published

Author(s)

Yooyoung Lee, P. Jonathon Phillips, James Filliben, J. R. Beveridge, Hao H. Zhang

Abstract

Methods for assessing the impact of factors and image-quality metrics for still face images are well-understood. The extension of these factors and quality measures to faces in video has not, however, been explored. We present a specific methodology for carrying out this extension from still to video. Using the Point-and-Shoot Challenge (PaSC) dataset, our study investigates the effect of nine factors on three face recognition algorithms, and identifies the most important factors for algorithm performance in video. We also evaluate four factor metrics for characterizing a single video as well as two comparative metrics for pairs of videos. For video-based face recognition, the analysis shows that distribution-based metrics are generally more effective in quantifying factor values than algorithm-dependent metrics. For predicting face recognition performance in video, we observe that the face detection confidence and face size factors are potentially useful quality measures. We also find that males are easier to identify than females, and Asians easier to identify than Caucasians. Finally, for this PaSC video dataset, face recognition algorithm performance is primarily driven by environment and sensor factors.
Proceedings Title
International Joint Conference on Biometrics (IJCB 2014)
Conference Dates
September 29-October 2, 2014
Conference Location
Clearwater, FL

Keywords

face recognition, sensitivity analysis, factor analysis, biometrics, forensics, video surveillance

Citation

Lee, Y. , Phillips, P. , Filliben, J. , Beveridge, J. and Zhang, H. (2014), Generalizing Face Quality and Factor Measures to Video, International Joint Conference on Biometrics (IJCB 2014), Clearwater, FL, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=916108 (Accessed November 29, 2022)
Created September 23, 2014, Updated June 24, 2021