Face Recognition Vendor Test (FRVT) Ongoing

Description

**********************

ALL frvt evaluation tracks reopenED on june 24, 2020.

**********************

New Test on the Effect of Masks on Face Recognition Accuracy

NIST will run a series of tests toward quantifying face recognition accuracy for people wearing masks.  Our approach will be to apply masks to faces digitally, i.e. using software to apply a synthetic mask.  This approach leverages current large datasets.  We intend to initially test 1:1 verification algorithms.  We will test algorithms already submitted to FRVT 1:1, and we will also invite submission of new algorithms that claim to handle masks.  We will first mask only the probe image, leaving the reference photo as is.  Later, we will consider the effect of masking both images.  We will quantify the effect of masks on both false negative and false positives match rates and issue a public report.

---

New FRVT Demographic Effects Report

A new FRVT report released as NISTIR 8280 - FRVT Part 3: Demographic Effects on December 19^th, 2019, describes and quantifies demographic differentials for contemporary face recognition algorithms. NIST has conducted tests to quantify demographic differences for nearly 200 face recognition algorithms from nearly 100 developers, using four collections of photographs with more than 18 million images of more than 8 million people. Using both one-to-one verification and one-to-many identification algorithms submitted to NIST, the report found empirical evidence for the existence of a wide range of accuracy across demographic differences in the majority of the current face recognition algorithms that were evaluated.

---

FRVT 1:1

Latest Report [2020-05-21]
API | Participation Agreement
Status: Open
Next Report: TBD

Learn More

FRVT 1:N

Latest Report [2020-03-24]
API | Participation Agreement
Status: Open
Next Report: TBD

Learn More

FRVT MORPH

Latest Report [2020-06-03]
API | Participation Agreement
Status: Open
Next Report: TBD

Learn More

FRVT Quality

Draft Report [2020-03-16]
API | Concept Document
Participation Agreement
Status: Open

Learn More

FAQs

Ongoing responses to a number of questions regarding the our FRVT evaluations are addressed in our FAQs document.

Number and Schedule of Submissions: FRVT is an ongoing activity and runs continuously.  For the FRVT 1:1, 1:N, and Quality tracks, participants may send one submission as often as every four calendar months from the last submission for evaluation.  For FRVT MORPH, the number and schedule of submissions is currently not regulated, so participants can send submissions at any time.  NIST reserves the right to amend submission volume and frequency limits at any time.
 

Contact Information

Inquiries and comments may be submitted to [e-mail].

 

Subscribe

Subscribe to the FRVT mailing list to receive emails when announcements or updates are made.

Biometrics, Software testing and Statistical analysis