FRVT 1:N Status
Evaluation of algorithms submitted to Phase 1 is complete, and developers have received an interim evaluation report. The deadline for participation in Phase 2 is June 21, 2018. It is open to Phase 1 developers and any new developers who would like to participate. Please do not submit anything to NIST before June 18, 2018. Separately, the FRVT Ongoing evaluation of 1:1 algorithms has re-started.
A few important notes to developers:
- We’ve updated the validation package to test your software on template generation from multiple input images. Please ensure your software can handle multi-image template generation. Some of our tests will require the processing of up to 1500 images in a single template.
- Please confirm that your software can handle very very large enrollment database sizes. Specifically, please ensure that your software (especially during finalize and search) can handle processing an enrollment database that exceeds 2^32 bytes in size.
- Your software must run on all of the compute architectures specified in the API document. Submissions must operate on machines that do not support AVX/FMA instructions. Please ensure there are no dependencies to these instructions in your software.
The FRVT 2018 will measure advancements in the accuracy and speed of one-to-many face recognition identification algorithms searching enrolled galleries containing at least 10 million identities. The evaluation will primarily use standardized portrait images, and will quantify how accuracy depends on subject-specific demographics and image-specific quality factors.
- API Document [last update: 2017-11-20]: The final version of the API document is now available. Developers must ensure that their submission conforms to the document's specifications.
- Validation [last update: 2018-05-14]: An updated validation package is now available here. All participants must run their software through the provided validation package prior to submission. The purpose of validation is to ensure consistent algorithm output between your execution and NIST's execution.
- Participation Agreement [last update: 2017-11-20]: FRVT is conducted by NIST, an agency of the United States Government. Participation is free of charge. FRVT is open to a global audience of face recognition developers. All organizations who seek to participate in FRVT must sign and submit all pages of this Participation Agreement. NOTE: Organizations that have already submitted a participation agreement for ongoing FRVT 1:1 do not need to send in a new participation agreement UNLESS the organization updates their cryptographic signing key.
- Encryption Instructions [last update: 2017-11-20]: All submissions must be properly encrypted and signed before transmission to NIST. This must be done according to these instructions using the FRVT Ongoing public key linked from this page. Participants must email their public key to NIST. The participant's public key must correspond to the participant's public-key fingerprint provided on the signed Participation Application.
- Submission Instructions [last update: 2017-11-20]: Encrypted files below 20MB can be emailed to NIST at firstname.lastname@example.org. Encrypted files above 20MB can be provided as a download link from a generic http webserver (e.g., Google Drive). We cannot accept Dropbox links. NIST will not register, or establish any kind of membership, on the provided website. Participants can submit their algorithm(s) as soon as the signed participation agreement is sent to NIST. There is no need to wait for NIST confirmation of the received agreement.
- Upcoming Important Dates [last update: 2017-11-20]: The first day algorithms can be sent to NIST for Phase 1 is January 22, 2018. The Phase 1 submission deadline is February 16, 2018.
2017-Oct-26: Program announcement and draft API
The first draft of the C++ API for the FRVT 1:N 2018 evaluation is now online. The document, which also describes the goals and concept, is open for public review. Please submit suggestions, comments and questions to email@example.com by November 15, 2017.
2017-Oct-26 - Nov-15: Draft API publication and public comments period
2017-Nov-16: Final API published
2018-Jan-22: First day algorithms can be sent to NIST
2018-Feb-16: Phase 1 submission deadline
2018-Jun-21: Phase 2 submission deadline
2018-Oct-19: Phase 3 submission deadline