Face Recognition Vendor Test (FRVT) Ongoing

Description

Updated Report on the Effect of Masks on Face Recognition Accuracy

NIST has published an update to NISTIR 8331 - Ongoing FRVT Part 6B: Face recognition accuracy with face masks using post-COVID-19 algorithms, aimed at quantifying face recognition accuracy for people wearing masks.  This update adds 35 new algorithms submitted to FRVT 1:1 since the last report (and includes cumulative results for 198 algorithms evaluated to date). 

Our initial approach has been to apply masks to faces digitally (i.e., using software to apply a synthetic mask). This allowed us to leverage large datasets that we already have. This report quantifies the effect of masks on both false negative and false positives match rates.  For more information, visit the FRVT Face Mask Effects webpage.

---

New FRVT Demographic Effects Report

A new FRVT report released as NISTIR 8280 - FRVT Part 3: Demographic Effects on December 19^th, 2019, describes and quantifies demographic differentials for contemporary face recognition algorithms. NIST has conducted tests to quantify demographic differences for nearly 200 face recognition algorithms from nearly 100 developers, using four collections of photographs with more than 18 million images of more than 8 million people. Using both one-to-one verification and one-to-many identification algorithms submitted to NIST, the report found empirical evidence for the existence of a wide range of accuracy across demographic differences in the majority of the current face recognition algorithms that were evaluated.

---

FRVT 1:1

Latest Report [2021-04-16]
API | Participation Agreement
Status: Open
Next Report: May 2021

Learn More

FRVT 1:N

Latest Report [2021-03-04]
API | Participation Agreement
Status: Open
Next Report: April 2021

Learn More

FRVT MORPH

Latest Report [2021-04-16]
API | Participation Agreement
Status: Open
Next Report: TBD

Learn More

FRVT Quality

Draft Report [2020-07-24]
API | Concept Document
Participation Agreement
Status: Open

Learn More

FAQs

Ongoing responses to a number of questions regarding the our FRVT evaluations are addressed in our FAQs document.

Number and Schedule of Submissions: FRVT is an ongoing activity and runs continuously.  For the FRVT 1:1, 1:N, and Quality tracks, participants may send one submission as often as every four calendar months from the last submission for evaluation.  For FRVT MORPH, the number and schedule of submissions is currently not regulated, so participants can send submissions at any time.  NIST reserves the right to amend submission volume and frequency limits at any time.
 

Contact Information

Inquiries and comments may be submitted to [e-mail].

 

Subscribe

Subscribe to the FRVT mailing list to receive emails when announcements or updates are made.

Biometrics, Software testing and Statistical analysis