Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Humans versus Algorithms: Comparisons from the Face Recognition Vendor 2006

Published

Author(s)

P J. Phillips, Alice J. O'Toole, Abhijit Narvekar

Abstract

We present a synopsis of results comparing the performance of humans with face recognition algorithms tested in the Face Recognition Vendor Test (FRVT) 2006 and Face Recognition Grand Challenge (FRGC). Algorithms and humans matched face identity in images taken under controlled and uncontrolled illumination. The human-machine comparisons include accuracy benchmarks, an error pattern analysis, and a test of human and machine performance stability across data sets varying in image quality. The results indicate that: 1.) machines can compete quantitatively with humans matching face identity across changes in illumination; 2.) qualitative differences between humans and machines can be exploited to improve identification by fusing human and machine match scores; and 3.) recognition skills for humans and machines are comparably stable across changes in image quality. Combined the results suggest that face recognition algorithms may be ready for applications with task constraints similar to those evaluated in the FRVT 2006.
Proceedings Title
8th IEEE International Conference on Automatic Face and Gesture Recognition
Conference Dates
September 17-19, 2008
Conference Location
Amsterdam, NL

Keywords

face recognition, human performance

Citation

Phillips, P. , O'Toole, A. and Narvekar, A. (2008), Humans versus Algorithms: Comparisons from the Face Recognition Vendor 2006, 8th IEEE International Conference on Automatic Face and Gesture Recognition, Amsterdam, NL, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=890058 (Accessed March 28, 2024)
Created September 17, 2008, Updated February 17, 2017