Biometrics Evaluation and Testing
Objective
Unfortunately, the reliability of these technologies remains difficult to compare. There are no european-wide standards for evaluating their accuracy, their robustness to attacks or their privacy preservation strength.
BEAT will fill this gap by building an online and open platform to transparently evaluate biometric systems, designing protocols and tools for vulnerability analysis and developing standardization documents for Common Criteria evaluations. The planned impact is three-fold: the reliability of biometric systems becomes standardized and comparable, potentially leading to a meaningful increase in their performance; technology transfer from research to companies becomes easier with the use of an interoperable framework; authorities and decision-makers become more informed about the progress made in biometrics as results impact standards.
Funding Scheme
CP-FP - Small or medium-scale focused research project
Coordinator
FONDATION DE L'INSTITUT DE RECHERCHE IDIAP
Address
Rue Marconi 19
1920 Martigny
Switzerland
Activity type
Research Organisations
EU Contribution
€ 958 797
Administrative Contact
Léonore Miauton (Mrs.)
Participants (10)
Sort alphabetically
Sort by EU Contribution
Expand all
UNIVERSIDAD AUTONOMA DE MADRID
Spain
EU Contribution
€ 530 400
UNIVERSITY OF SURREY
United Kingdom
EU Contribution
€ 415 945
ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE
Switzerland
EU Contribution
€ 64 800
TURKIYE BILIMSEL VE TEKNOLOJIK ARASTIRMA KURUMU
Turkey
EU Contribution
€ 281 000
COMMISSARIAT A L ENERGIE ATOMIQUE ET AUX ENERGIES ALTERNATIVES
France
EU Contribution
€ 435 759
IDEMIA IDENTITY & SECURITY FRANCE
France
EU Contribution
€ 265 493
TUV INFORMATIONSTECHNIK GMBH UNTERNEHMENSGRUPPE TUV NORD
Germany
EU Contribution
€ 267 990
KATHOLIEKE UNIVERSITEIT LEUVEN
Belgium
EU Contribution
€ 151 200
HAUTE ECOLE SPECIALISEE DE SUISSE OCCIDENTALE
Switzerland
EU Contribution
€ 28 702,80
CHALMERS TEKNISKA HOEGSKOLA AB
Sweden
EU Contribution
€ 99 697,20
Project information
BEAT
Grant agreement ID: 284989
Status
Closed project
-
Start date
1 March 2012
-
End date
29 February 2016
Funded under:
FP7-SECURITY
-
Overall budget:
€ 4 743 988,40
-
EU contribution
€ 3 499 784
New standards and assessments to improve biometrics
SECURITY
DIGITAL ECONOMY
Keywords
Biometrics, security, operational evaluations, BEAT, standardisation, privacy
Project information
BEAT
Grant agreement ID: 284989
Status
Closed project
-
Start date
1 March 2012
-
End date
29 February 2016
Funded under:
FP7-SECURITY
-
Overall budget:
€ 4 743 988,40
-
EU contribution
€ 3 499 784
Discover other articles in the same domain of application
Final Report Summary - BEAT (Biometrics Evaluation and Testing)
Identity management using Biometrics is a reality because of the e-passport (Biometric passport). Similar biometric technology has also become more prevalent on personal computers with more biometric-enabled functions and applications to recognize nomadic users through biometrics emerged as mobile devices are equipped with more sensors. Unfortunately the reliability of these biometric technologies is not always known and therefore cant be guaranteed. In particular the three criteria of (1) the performance of the underlying biometric system, (2) the robustness to vulnerabilities such as direct (spoofing) or indirect attacks, and (3) the strength of privacy preservation techniques, are often unknown or impossible to compare to competitors.
The lack of standard operational evaluations is the reason that we cannot measure the reliability of these biometric technologies. Some initiatives exist in Europe, the United States of America, and Asia. However, these initiatives are: isolated (focusing only on one or two biometric modalities), disorganized (teams from the same institution can work on different biometrics without talking to each other), or limited in time (very few are organizing ongoing evaluations). This leads to discontinuous and non-integrated efforts which have a limited life span. Thus there is a need for establishing a framework to evaluate, in a systematic way, the performance of biometric technologies using several metrics and criteria (performance, vulnerability, privacy).
Project Context and Objectives:
The goal of BEAT is to propose a framework of standard operational evaluations for biometric technologies. This was achieved by
- developing an online and open platform to transparently and independently evaluate biometric systems against validated benchmarks,
- designing protocols and tools for vulnerability analysis, and
- developing standardization documents for Common Criteria evaluations.
Additionally, legal aspects were considered to address the issues of both privacy data protection and Intellectual Property and so ensure that the BEAT framework can be used by the research community and companies.
There are three outcomes of this project. The first is that the reliability of biometric systems is measurable and thus should lead to a meaningful increase in performance. The second is that technology transfer from research to companies is much easier as there will be an interoperable framework. Finally, decision-makers and authorities are informed about the progress that is made in biometrics as the results have an impact on standards. Given these outcomes we are convinced that BEAT significantly contributed to the development of a European Identification Certification System.
BEAT has identified 8 concrete objectives in the description of work. We list them below and shortly mention how they were achieved.
1. Evaluation of the performance of biometric systems:
All deliverables from WorkPackage "Evaluation of Biometric Performance" (D3.1 to D3.7) were completed and submitted. In addition some of the biometric algorithms, metrics and databases are available on the BEAT platform. The reader is referred to the section 2 of the deliverable D7.6 and to the main S&T result 1-2 in the next section.
2. Evaluation of the vulnerabilities of biometric systems:
All deliverables from WorkPackage "Evaluation of Vulnerabilities" (D4.1 to D4.8) were completed and submitted. In addition some of the biometric algorithms, metrics and databases are available on the BEAT platform. The reader is referred to the section 2 of the deliverable D7.6 and to the main S&T result 2 in the next section.
3. Evaluation of privacy preservation mechanisms:
All deliverables from WorkPackage "Evaluation of Privacy Preservation" (D5.1 to D5.5) were completed and submitted. The reader is referred to the main S&T result 2 in the next section.
4. Integration and deployment of the BEAT platform:
All deliverables from WorkPackages "Specification and Design" (D2.1 to D2.6) and \Integration and Deployment" (D7.1 to D7.6) were completed and submitted. The reader is referred to the main S&T result 5 in the next section. The BEAT platform is operational and running ( https://www.beat-eu.org/platform/ ) and open source ( https://gitlab.idiap.ch/groups/beat ).
5. Dissemination on research activities:
Deliverables from WorkPackage "Dissemination and Exploitation" (D8.1 to D8.3) were completed and submitted. BEAT research activities were disseminated to a large audience through the organization and participation to events and the publication of scientific papers in major journals and international conferences.
6. Exploitation activities:
Deliverables from WorkPackage "Dissemination and Exploitation" (D8.4 to D8.6) were completed and submitted. In addition, BEAT has generated 2 patents, 1 license agreement and prepared its legacy as the \Swiss Center for Biometrics Research and Testing" ( http://www.
biometrics-center.ch/testing ). This center will maintain the BEAT platform and host public standardization documents such as the D6.5 \Toward Common Criteria evaluations of biometric systems".
7. Developing standardization documents:
Deliverables from WorkPackage "Standards and Certification" (D6.1 to D6.5) were completed and submitted. The reader is referred to the main S&T result 3 in the next section. We contributed to international standardization activities (SC27 and SC37) by proposing security evaluation standards for biometrics. In January 2016 the "Information technology - Biometric presentation attack detection - Part 1: Framework" standard
ISO/IEC 30107-1:2016 ( http://www.iso.org/iso/catalogue_detail.htm?csnumber=53227 ) was published resulting from many contributions by BEAT partners. In addition, the deliverable D6.5 "Toward Common Criteria evaluations of biometric systems" was completed and will be proposed to Common Criteria for testing biometric products in the future.
8. Legal aspects:
Deliverables from WorkPackage "Legal Aspects of Privacy and Intellectual Property" (D9.1 to D9.4) were completed and submitted. The reader is refered to the main S&T result 4 in the next section.
Project Results:
cf report D1.7 chapter 1.3 Main S&T Results - Foregrounds, attached to this form
Potential Impact:
cf report D1.7 chapter 1.4 Societal Impacts, attached to this form
List of Websites:
https://www.beat-eu.org/
Project information
BEAT
Grant agreement ID: 284989
Status
Closed project
-
Start date
1 March 2012
-
End date
29 February 2016
Funded under:
FP7-SECURITY
-
Overall budget:
€ 4 743 988,40
-
EU contribution
€ 3 499 784
Deliverables
Deliverables not available
Publications
Project information
BEAT
Grant agreement ID: 284989
Status
Closed project
-
Start date
1 March 2012
-
End date
29 February 2016
Funded under:
FP7-SECURITY
-
Overall budget:
€ 4 743 988,40
-
EU contribution
€ 3 499 784
Project information
BEAT
Grant agreement ID: 284989
Status
Closed project
-
Start date
1 March 2012
-
End date
29 February 2016
Funded under:
FP7-SECURITY
-
Overall budget:
€ 4 743 988,40
-
EU contribution
€ 3 499 784
