1、BSI Standards PublicationEnvironmental influence testing methodology for operational deployments of European ABC systemsPD CEN/TS 16920:2016National forewordThis Published Document is the UK implementation of CEN/TS 16920:2016.The UK participation in its preparation was entrusted to TechnicalCommitt
2、ee IST/44, Biometrics.A list of organizations represented on this committee can be obtained onrequest to its secretary.This publication does not purport to include all the necessary provisions ofa contract. Users are responsible for its correct application. The British Standards Institution 2016.Pub
3、lished by BSI Standards Limited 2016ISBN 978 0 580 91180 4ICS 35.240.15Compliance with a British Standard cannot confer immunity fromlegal obligations.This Published Document was published under the authority of theStandards Policy and Strategy Committee on 30 April 2016.Amendments/corrigenda issued
4、 since publicationDate Text affectedPUBLISHED DOCUMENTPD CEN/TS 16920:2016TECHNICAL SPECIFICATION SPCIFICATION TECHNIQUE TECHNISCHE SPEZIFIKATION CEN/TS 16920 March 2016 ICS 35.240.15 English Version Environmental influence testing methodology for operational deployments of European ABC systems Mtho
5、dologie de tests de linfluence environnementale pour les dploiements oprationnels des systmes europens de contrle de passages aux frontires automatiss Testmethodik fr Umwelteinflsse beim operationellen Einsatz von europischen ABC-Systemen This Technical Specification (CEN/TS) was approved by CEN on
6、25 January 2016 for provisional application. The period of validity of this CEN/TS is limited initially to three years. After two years the members of CEN will be requested to submit their comments, particularly on the question whether the CEN/TS can be converted into a European Standard. CEN member
7、s are required to announce the existence of this CEN/TS in the same way as for an EN and to make the CEN/TS available promptly at national level in an appropriate form. It is permissible to keep conflicting national standards in force (in parallel to the CEN/TS) until the final decision about the po
8、ssible conversion of the CEN/TS into an EN is reached. CEN members are the national standards bodies of Austria, Belgium, Bulgaria, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, Former Yugoslav Republic of Macedonia, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Li
9、thuania, Luxembourg, Malta, Netherlands, Norway, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey and United Kingdom. EUROPEAN COMMITTEE FOR STANDARDIZATION COMIT EUROPEN DE NORMALISATION EUROPISCHES KOMITEE FR NORMUNG CEN-CENELEC Management Centre: Avenue Marnix 17,
10、 B-1000 Brussels 2016 CEN All rights of exploitation in any form and by any means reserved worldwide for CEN national Members. Ref. No. CEN/TS 16920:2016 EPD CEN/TS 16920:2016CEN/TS 16920:2016 (E) 2 Contents Page European foreword . 3 Introduction 3 1 Scope 5 2 Normative references 5 3 Terms and def
11、initions . 6 4 Symbols and abbreviations . 7 5 Overview of evaluating the influence of ambient conditions in European ABC systems . 7 5.1 Introduction to ISO/IEC 29197 evaluations 7 5.2 Application of the ISO/IEC 29197 evaluation methodology to European ABC systems 8 5.2.1 General 8 5.2.2 Environmen
12、tal parameters influencing biometric performance of the European ABC systems . 8 5.2.3 Specific characteristics of biometric modules of the European ABC systems . 9 5.2.4 Privacy and data protection legislation of the European ABC systems 10 6 Evaluation conditions specification 10 6.1 Introduction
13、. 10 6.2 Tests for the environmental influence evaluation of European ABC systems . 10 6.2.1 General . 10 6.2.2 Tests for analysing the influence of one environmental parameter . 10 6.2.3 Tests for analysing the influence of a specific environment 14 6.3 Recommendations for the selections of the tes
14、ts . 15 6.4 Recommendations for the selection of specific values . 15 7 Requirements for biometric performance testing of ABC system when conducting ISO/IEC 29197 evaluations . 17 7.1 Test crew demographic characteristics . 17 7.2 Acclimatization . 18 Bibliography . 19 PD CEN/TS 16920:2016CEN/TS 169
15、20:2016 (E) 3 European foreword This document (CEN/TS 16920:2016) has been prepared by Technical Committee CEN/TC 224 “Personal identification and related personal devices with secure element, systems, operations and privacy in a multi sectorial environment”, the secretariat of which is held by AFNO
16、R. Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. CEN and/or CENELEC shall not be held responsible for identifying any or all such patent rights. According to the CEN-CENELEC Internal Regulations, the national standards organizat
17、ions of the following countries are bound to announce this Technical Specification: Austria, Belgium, Bulgaria, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, Former Yugoslav Republic of Macedonia, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg,
18、 Malta, Netherlands, Norway, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey and the United Kingdom. PD CEN/TS 16920:2016CEN/TS 16920:2016 (E) 4 Introduction This Technical Specification is focused on the application of the testing methodology defined in ISO/IEC 291
19、97 for analysing the influence of environmental conditions on the biometric performance of European automatic border control (ABC) systems according to the features of these systems, the specificities of these systems for the European context and their intended operational environment, i.e. airports
20、 and port halls. ABC systems are automated systems which can verify the identity of travellers crossing the borders at the border crossing points, without the need for human intervention. These systems are used by many European countries for supporting border control officer activities. Their object
21、ive is to improve border crossing processes and achieve consistent security levels throughout Europe. As a consequence, it is required that these systems conform to ISO/IEC standards for interoperability (see CEN/TS 16634:2014, Personal identification Recommendations for using biometrics in European
22、 Automated Border Control, Clause 1). Among these standards, the multipart standard ISO/IEC 19795 “Biometric Performance Testing and Reporting” establishes requirements for planning, executing and reporting biometric performance evaluations. However, due to the fact that this set of standards does n
23、ot cover the analysis of environmental conditions influence on biometric performance, ISO/IEC JTC1 SC37 WG5 began a new project for establishing a testing methodology to quantify those environmental effects. This project is ISO/IEC 29197 “Information technology Evaluation methodology for environment
24、al influence in biometric system performance”. However, this methodology is generic and its requirements have been specified to cover the analysis of several environmental parameters (e.g. temperature, humidity, atmospheric pressure, illumination, noise, etc.) considering all possible operational en
25、vironments. Depending on the particular features of the biometric system under test and the expected operational environment, those requirements should be particularized. European ABC systems have biometric modules which have common and well-defined features. Firstly, European ABC systems may use on
26、e or a combination of three biometric modalities: facial, fingerprint and iris (as it is specified by CEN/TS 16634:2014, Personal identification Recommendations for using biometrics in European Automated Border Control, 4.1). Therefore, there are certain environmental conditions that affect such mod
27、alities to a greater extent according to ISO/IEC/TR 19795-3. On the other hand, European ABC systems are localized in specific environments such as airports, railway stations and sea ports (as it is mentioned in CEN/TS 16634:2014, Personal identification Recommendations for using biometrics in Europ
28、ean Automated Border Control, 5.1.1). As a result, it is possible to predict which are going to be the surrounding environmental conditions of the ABC systems and to analyse whether the systems work properly or not for the possible values of such conditions. If the biometric performance of European
29、ABC systems is affected by any environmental condition and this problem is not detected in early stages, it may cause negatively effects in future. In addition, European ABC systems are subjected to privacy and data protection legislation (e.g. Directive 95/46/EC). Therefore, their analysis should c
30、omply with the limitations imposed by EU and data protection regulations (see CEN/TS 16634:2014, Personal identification Recommendations for using biometrics in European Automated Border Control, 5.1.3.6 and 5.1.4). Consequently and considering the importance to accurately check the correct behaviou
31、r of the biometric recognition functionality of European ABC systems in their expected host environment, it is essential to specify the general testing methodology addressed by ISO/IEC 29197 for the characteristics and needs of European ABC systems. PD CEN/TS 16920:2016CEN/TS 16920:2016 (E) 5 1 Scop
32、e The purpose of this document is to specify the ISO/IEC 29197 testing methodology for European ABC systems. This specification will cover the following aspects: environmental conditions which influence biometric modalities used for European ABC systems, i.e. temperature, humidity, illumination and
33、noise; different tests that can be defined regarding European ABC systems and the procedures for defining of the evaluation conditions to analyse per each test; particular characteristics of European ABC systems in accordance to best practice recommendations and privacy and data protection regulatio
34、ns for this kind of systems in case of European deployments. As a consequence, the proposed document will include the following aspects: specific requirements for planning and executing environmental testing evaluations for European ABC systems based on ISO/IEC 29197 project and the best practices r
35、ecommendations provided by CEN/TS 16634 Personal identification Recommendations for using biometrics in European Automated Border Control document; recommendations for the selection of the possible tests according to the specific system that is going to be evaluated; specific requirements to establi
36、sh and measure such evaluation conditions as well as to establish the baseline performance; a specification of the biometric performance evaluation including requirements for test population, test protocols, data to record and test results consistent with operational deployments of European ABC syst
37、ems. 2 Normative references The following documents, in whole or in part, are normatively referenced in this document and are indispensable for its application. For dated references, only the edition cited applies. For undated references, the latest edition of the referenced document (including any
38、amendments) applies. CEN/TS 16634:2014, Personal identification - Recommendations for using biometrics in European Automated Border Control ISO/IEC 29197:2015, Information technology Evaluation methodology for environmental influence in biometric system performance PD CEN/TS 16920:2016CEN/TS 16920:2
39、016 (E) 6 3 Terms and definitions For the purposes of this document, the following terms and definitions apply. 3.1 environmental conditions all atmospheric parameters and other physical and chemical phenomena that can surround the European ABC system and influence on its performance Note 1 to entry
40、: The term “environmental conditions” entails more aspects than “ambient conditions”. However, the term “ambient conditions” can also refer to conditions that occur naturally in contrast to conditions that have been induced. Therefore, it has been preferred to use the term “environmental conditions”
41、. Note 2 to entry: It is important to distinguish two concepts related to this term: operational environment: the environmental conditions under which the European ABC system is expected to operate. This concept does not associate any predefined value; extreme conditions: environmental conditions th
42、at entail very high or very low values and may be hostile for systems operation or even human life. 3.2 environmental generator equipment used to establish and maintain the controlled conditions of the test (e.g. an air conditioning system) 3.3 evaluation conditions each of the evaluations carried o
43、ut in a different evaluation environment to assess the performance of European ABC systems in one or more specific environmental conditions 3.4 evaluation configuration physical layout of the environment in which the European ABC is going to be tested including the necessary equipments for performin
44、g tests 3.5 evaluation environment environment in which the biometric system is evaluated considering the environmental conditions and the evaluation configuration 3.6 instrument calibrated equipment used to measure and/or record environmental parameters (e.g. a thermometer) 3.7 parties involved in
45、the evaluation entities or organizations which are interested in the evaluation and have responsibilities in the evaluation process Note 1 to entry: These entities are basically two: the test laboratory which is going to conduct the evaluation and the developer or customer who request to carry out t
46、he evaluation. In case the developer is different from the customer (e.g. an end-user requesting to know the performance of a commercial European ABC system), a third entity is added to the number of parties. Note 2 to entry: Test subjects are not considered a party of the evaluation although they h
47、ave to take part in it. PD CEN/TS 16920:2016CEN/TS 16920:2016 (E) 7 3.8 reference evaluation environment REE evaluation environment in which the European ABC system is analysed to obtain baseline performance metrics for making comparisons 3.9 target evaluation environment TEE evaluation environment
48、in which the European ABC system is analysed to obtain performance metrics for studying the influence of certain environmental conditions, by comparing with the results obtained at the REE 4 Symbols and abbreviations For the purposes of this document, the following symbols and abbreviations apply. A
49、BC Automatic Border Control REE Reference Evaluation Environment TEE Target Evaluation Environment 5 Overview of evaluating the influence of ambient conditions in European ABC systems 5.1 Introduction to ISO/IEC 29197 evaluations ISO/IEC 29197 defines a general evaluation methodology for analysing the influence of environmental conditions on biometric systems performance. The model established for this evaluation methodology entails to conduct an “end-to-end” ISO/IEC 19795-1:2006 biometric performance evaluation, i.e. a scenario ev