Criteria Towards Metrics for Benchmarking Template Protection Algorithms

Published: March 30, 2012


Eddy Simoens, Bian Yang, Xuebing Zhou, Filipe Beato, Christoph Busch, Elaine M. Newton, Bart Preneel


Traditional criteria used in biometric performance evaluation do not cover all the performance aspects of biometric template protection (BTP) and the lack of well-defined metrics inhibits the proper evaluation of such methods. Previous work in the literature focuses, in general, on a limited set of criteria and methods. This paper provides the first holistic approach to the evaluation of biometric template protection that is able to cover a whole range of methods. We present a selection of well-defined criteria and metrics that are compliant with the reference architecture for template protection as defined in the recently adopted standard ISO/IEC 24745 (2011), which is applicable to nearly all known BTP methods. The metrics have been grouped in three categories of performance: technical, security and privacy, and operational. In addition, the visualization and representation of scores is discussed and a method for the unification of scores is proposed.
Proceedings Title: Proceedings of the 5th IEEE/IAPR International Conference on Biometrics (ICB 2012)
Conference Dates: March 30-April 1, 2012
Conference Location: New Delhi, -1
Conference Title: 5th IEEE/IAPR International Conference on Biometrics (ICB 2012)
Pub Type: Conferences


biometrics, template protection, BTP, renewable biometrics, revocable biometrics, cancellable biometrics, benchmark testing
Created March 30, 2012, Updated February 19, 2017