Skip to main content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Face Recognition Vendor Test (FRVT) Ongoing

Description

**********************

In light of COVID-19 guidance from Federal, State and local health authorities, NIST has made temporary adjustments to staffing and operations to protect the health and safety of NIST employees and the public. As a result of these changes, ALL frvt evaluation tracks submissions are temporarily suspended. Thank you for your understanding. 

**********************

New Test on the Effect of Masks on Face Recognition Accuracy

NIST will run a series of tests toward quantifying face recognition accuracy for people wearing masks.  Our approach will be to apply masks to faces digitally, i.e. using software to apply a synthetic mask.  This approach leverages current large datasets.  We intend to initially test 1:1 verification algorithms.  We will test algorithms already submitted to FRVT 1:1, and we will also invite submission of new algorithms that claim to handle masks.  We will first mask only the probe image, leaving the reference photo as is.  Later, we will consider the effect of masking both images.  We will quantify the effect of masks on both false negative and false positives match rates and issue a public report.

The timing for this activity is uncertain because FRVT is currently closed (see above).  We have done considerable preparatory work and anticipate issuing a public report shortly after resuming FRVT.  We will accept FRVT algorithms from developers only after FRVT resumes.  We will announce resumption of FRVT to FRVT-NEWS group subscribers. [Subscribe]


New FRVT Demographic Effects Report

A new FRVT report released as NISTIR 8280 - FRVT Part 3: Demographic Effects on December 19th, 2019, describes and quantifies demographic differentials for contemporary face recognition algorithms. NIST has conducted tests to quantify demographic differences for nearly 200 face recognition algorithms from nearly 100 developers, using four collections of photographs with more than 18 million images of more than 8 million people. Using both one-to-one verification and one-to-many identification algorithms submitted to NIST, the report found empirical evidence for the existence of a wide range of accuracy across demographic differences in the majority of the current face recognition algorithms that were evaluated.


FRVT 1:1

Latest Report [2020-03-25]
APIParticipation Agreement
Status: Temporarily Suspended
Next Report: TBD

Learn More

FRVT 1:N

Latest Report [2020-03-24]
API | Participation Agreement
Status: Temporarily Suspended
Next Report: TBD

Learn More

FRVT MORPH

Latest Report [2020-03-04]
API | Participation Agreement
Status: Temporarily Suspended
Next Report: TBD

Learn More

FRVT Quality

Draft Report [2020-03-06]
API | Concept Document
Participation Agreement
Status: Temporarily Suspended

Learn More

FAQs

Ongoing responses to a number of questions regarding the our FRVT evaluations are addressed in our FAQs document.

Number and Schedule of Submissions: FRVT is an ongoing activity and runs continuously.  For the FRVT 1:1, 1:N, and Quality tracks, participants may send one submission as often as every four calendar months from the last submission for evaluation.  For FRVT MORPH, the number and schedule of submissions is currently not regulated, so participants can send submissions at any time.  NIST reserves the right to amend submission volume and frequency limits at any time.
 

Contact Information

Inquiries and comments may be submitted to frvt@nist.gov.

 

Subscribe

Subscribe to the FRVT mailing list to receive emails when announcements or updates are made.

Created December 14, 2016, Updated May 1, 2020