NIST logo
*

Face, Iris, & Multimodal Testing

Summary:

This project Advances standards and metrology in assessing performance of face, iris, & multimodal biometric system technologies while promoting innovation within industry through reference implementations and coordinated performance assessment activities. The project addresses issues including testing and interoperability to support development, standardization, and procurement of next generation face, iris, & multimodal biometric systems.

Description:

Measuring the performance of biometric systems is challenging because:

  1. Many component technologies are required, including lossy compression, quality assessment, image enhancement, feature extraction, pattern recognition, n-stage matching, 1-to-1 verification, and 1-to-N identification;
  2. Government fingerprint applications are growing to 100’s of millions of enrolled subjects;
  3. These systems must provide utility for the benefit of the country in the midst of errors, including failure to acquire, failure to segment, false matches, and false rejects.

To address these challenges, empirical benchmark studies are needed to measure and study these sources of error. Otherwise, decision makers and procurement officials are left to work with unverified claims of performance and capability. Independent evaluation of iris technologies is particularly important due to the history of intellectual property protection under patent which prevented open study of the technology.

Activities

  1. Multiple Biometric Grand Challenge (MBGC) : Still Face, Iris Portal, and Video Tracks and
  2. Multiple Biometric Evaluation (MBE) : Iris Portal and Video Tracks
  3. MBE: Still Face Track – large-scale face identification and verification testing
  4. Iris Exchange (IREX) Testing
  5. Iris Quality Calibration and Evaluation (IQCE)
  6. IARPA/Biometrics Exploitation Science and Technology (BEST) program support in the areas of face recognition from video and periocular recognition
  7. Iris and Face Technology Demonstration and Evaluation (IFTDE) – a pilot demonstration program for stand-off iris recognition technologies conducted by DHS with NIST to support US-VISIT.

The group works closely with other agency partners, including the FBI, DHS, and DOD in order to assess the performance of technologies used in very large scale fingerprint systems such as DHS US-VISIT/IDENT, DOD ABIS, and FBI IAFIS & NGI,. These activities support national applications of law enforcement and counterterrorism.

Major Accomplishments:

FY10

  1. The IREX Testing Team was honored to receive the NIST Bronze Medal – "For advancing identity verification, homeland security, and law enforcement by developing, evaluating, and standardizing iris image records in biometric systems."
  2. The Face Recognition Testing Team completed the MBE: Still Face Track demonstrating excellent leadership in the experimental design, technical community outreach, implementation, and analysis/editing.  This first-of-its-kind study assessed the state of the art in facial photo identification and verification in modes and to scale never before independently tested. The work was accomplished under a very compressed timeframe, and in the end provided relevant market research critical to the FBI's NGI Program. ("Report on the Evaluation of 2D Still-Image Face Recognition Algorithms" - NISTIR 7709, June 2010).

FY11

  1. (Qtr 2) The first in a series of NISTIRs will be published from results derived from the Iris Quality Calibration and Evaluation (IQCE), which is testing the effectiveness and interoperability of iris image quality assessment algorithms. [Lead: Elham Tabassi]
  2. (Qtr 2-3) IREX III will be launched to test large scale iris-based identification and verification technologies. This test will be on par in size and complexity as the MBE: Still Face Track. What that test accomplished for face recognition, IREX III will accomplish for iris recognition. [Lead: Patrick Grother]

Start Date:

January 2, 1998

End Date:

ongoing

Lead Organizational Unit:

itl

Source of Extramural Funding:

DHS/US-VISIT

Customers/Contributors/Collaborators:

DHS/US-VISIT
DOD/BTF
FBI/BCOE

Facilities/Tools Used:

MBARK Lab - Bldg 225
Biometrics Research Lab (A) - Bldg. 225
Biometrics Research Lab (B) - Bldg. 222
Biometrics Research Lab (C) - Bldg. 225

Staff:

Matt Aronoff
Tanya Brewer (CSD)
Su Cheng
Brian Cochran
Patricia Flanagan
Michael Garris
Kayee Kwong
Karen Marshall
George Quinn
Brad Wing
Jack Wydler
Patrick Grother (Co-PL)
Ross Micheals (Co-PL)

Contact

Patrick Grother
(Information Access Division)
(301)975-4157
patrick.grother(at)nist.gov

Ross Micheals
(Information Access Division)
(301)975-3234
ross.micheals(at)nist.gov