FRVT 1:N Status
Phase 2 is now underway evaluating 65 algorithms from 40 developers, with a public report scheduled for September 2018. Thereafter, Phase 3 will commence: algorithms must be submitted October 24 to 30, 2018. An updated API document has been published in preparation for Phase 3. The validation package will also be updated to reflect these changes in the upcoming weeks.
A few important notes to developers:
- For Phase 3, the finalizeEnrollment() function has been updated to include the configuration directory has an input parameter.
- Developers cannot assume that initializeTemplateCreation() is called by the test harness prior to initializeIdentification() and/or identifyTemplate().
- We’ve updated the validation package to test your software on template generation from multiple input images. Please ensure your software can handle multi-image template generation. Some of our tests will require the processing of up to 1500 images in a single template.
- Please confirm that your software can handle very very large enrollment database sizes. Specifically, please ensure that your software (especially during finalize and search) can handle processing an enrollment database that exceeds 2^32 bytes in size.
- Your software must run on all of the compute architectures specified in the API document. Submissions must operate on machines that do not support AVX/FMA instructions. Please ensure there are no dependencies to these instructions in your software.
The FRVT 2018 will measure advancements in the accuracy and speed of one-to-many face recognition identification algorithms searching enrolled galleries containing at least 10 million identities. The evaluation will primarily use standardized portrait images, and will quantify how accuracy depends on subject-specific demographics and image-specific quality factors.
- API Document [last update: 2018-07-24]: The API document has been updated for Phase 3. Developers must ensure that their submission conforms to the document's specifications.
- Validation [last update: 2018-09-07]: Updates to the validation package to reflect the API changes for Phase 3 are now available. All participants must run their software through the provided validation package prior to submission. The purpose of validation is to ensure consistent algorithm output between your execution and NIST's execution.
- Participation Agreement [last update: 2017-11-20]: FRVT is conducted by NIST, an agency of the United States Government. Participation is free of charge. FRVT is open to a global audience of face recognition developers. All organizations who seek to participate in FRVT must sign and submit all pages of this Participation Agreement. NOTE: Organizations that have already submitted a participation agreement for ongoing FRVT 1:1 do not need to send in a new participation agreement UNLESS the organization updates their cryptographic signing key.
- Encryption Instructions [last update: 2017-11-20]: All submissions must be properly encrypted and signed before transmission to NIST. This must be done according to these instructions using the FRVT Ongoing public key linked from this page. Participants must email their public key to NIST. The participant's public key must correspond to the participant's public-key fingerprint provided on the signed Participation Application.
- Submission Instructions [last update: 2017-11-20]: Encrypted files below 20MB can be emailed to NIST at firstname.lastname@example.org. Encrypted files above 20MB can be provided as a download link from a generic http webserver (e.g., Google Drive). We cannot accept Dropbox links. NIST will not register, or establish any kind of membership, on the provided website. Participants can submit their algorithm(s) as soon as the signed participation agreement is sent to NIST. There is no need to wait for NIST confirmation of the received agreement.
2017-Oct-26: Program announcement and draft API
The first draft of the C++ API for the FRVT 1:N 2018 evaluation is now online. The document, which also describes the goals and concept, is open for public review. Please submit suggestions, comments and questions to email@example.com by November 15, 2017.
2017-Oct-26 - Nov-15: Draft API publication and public comments period
2017-Nov-16: Final API published
2018-Jan-22: First day algorithms can be sent to NIST
2018-Feb-16: Phase 1 submission deadline
2018-Jun-21: Phase 2 submission deadline
2018-Oct-30: Phase 3 submission deadline