NIST has published NISTIR 8331 - Ongoing FRVT Part 6B: Face recognition accuracy with face masks using post-COVID-19 algorithms on November 30, 2020, the second out of a series of reports aimed at quantifying face recognition accuracy for people wearing masks. This report adds 1) 65 new algorithms submitted to FRVT 1:1 since mid-March 2020 (and includes cumulative results for 152 algorithms evaluated to date) and 2) assessment of when both the enrollment and verification images are masked (in addition to when only the verification image is masked). Our initial approach has been to apply masks to faces digitally (i.e., using software to apply a synthetic mask). This allowed us to leverage large datasets that we already have. This report quantifies the effect of masks on both false negative and false positives match rates. For more information, visit the FRVT Face Mask Effects webpage.
A new FRVT report released as NISTIR 8280 - FRVT Part 3: Demographic Effects on December 19th, 2019, describes and quantifies demographic differentials for contemporary face recognition algorithms. NIST has conducted tests to quantify demographic differences for nearly 200 face recognition algorithms from nearly 100 developers, using four collections of photographs with more than 18 million images of more than 8 million people. Using both one-to-one verification and one-to-many identification algorithms submitted to NIST, the report found empirical evidence for the existence of a wide range of accuracy across demographic differences in the majority of the current face recognition algorithms that were evaluated.
Latest Report [2021-01-19]
API | Participation Agreement
Status: Open
Next Report: March 2021
Latest Report [2021-02-09]
API | Participation Agreement
Status: Open
Next Report: March 2021
Latest Report [2021-02-02]
API | Participation Agreement
Status: Open
Next Report: TBD
Draft Report [2020-07-24]
API | Concept Document
Participation Agreement
Status: Open