1、BSI Standards Publication BS ISO/IEC 29197:2015 Information technology Evaluation methodology for environmental influence in biometric system performanceBS ISO/IEC 29197:2015 BRITISH STANDARD National foreword This British Standard is the UK implementation of ISO/IEC 29197:2015. The UK participation
2、 in its preparation was entrusted to Technical Committee IST/44, Biometrics. A list of organizations represented on this committee can be obtained on request to its secretary. This publication does not purport to include all the necessary provisions of a contract. Users are responsible for its corre
3、ct application. The British Standards Institution 2015. Published by BSI Standards Limited 2015 ISBN 978 0 580 76394 6 ICS 35.020 Compliance with a British Standard cannot confer immunity from legal obligations. This British Standard was published under the authority of the Standards Policy and Stra
4、tegy Committee on 31 March 2015. Amendments/corrigenda issued since publication Date T e x t a f f e c t e dInformation technology Evaluation methodology for environmental influence in biometric system performance Technologies de linformation Mthodologie de lvaluation de linfluence environnementale
5、dans la performance dun systme biomtrique INTERNATIONAL STANDARD ISO/IEC 29197 Reference number ISO/IEC 29197:2015(E) First edition 2015-04-01 ISO/IEC 2015 BS ISO/IEC 29197:2015ii ISO/IEC 2015 All rights reserved COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2015 All rights reserved. Unless otherwise specifi
6、ed, no part of this publication may be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below or ISOs
7、 member body in the country of the requester. ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.org Published in Switzerland ISO/IEC 29197:2015(E)BS ISO/IEC 29197:2015ISO/IEC 29197:2015(E)Foreword v Introduction vi
8、 1 Scope . 1 2 Conformance . 1 3 Normative references 1 4 Terms and definitions . 2 5 Overview . 3 5.1 Introduction 3 5.2 Scenario evaluations 4 5.3 Operational evaluations 4 6 Evaluation conditions specification . 5 6.1 Introduction 5 6.2 Definition of evaluation conditions . 5 6.2.1 Description of
9、 the evaluation conditions 5 6.2.2 Types of environmental parameters 5 6.3 Selection of the evaluation conditions 6 6.3.1 General 6 6.3.2 Reference evaluation environment for scenario evaluations 6 6.3.3 Target evaluation environments 6 6.4 Measurement and recording of the environmental conditions 8
10、 6.4.1 General 8 6.4.2 Instruments to measure and record environmental conditions 8 6.4.3 Requirements for measuring and recording environmental conditions . 8 7 Biometric scenario evaluation . 9 7.1 Introduction 9 7.2 Define evaluation objectives . 9 7.3 Environment . 9 7.3.1 Environment for enrolm
11、ent . 9 7.3.2 Generation and control of the environmental conditions 9 7.3.3 Biometric system placement 10 7.4 Test population 10 7.4.1 General.10 7.4.2 Size 10 7.4.3 Selection .11 7.4.4 Training and guidance of test subjects 11 7.4.5 Visits 12 7.5 Acclimatization 12 7.6 Levels of effort and decisio
12、n policies 12 7.7 Exception handling protocols12 7.8 Data to record and test results .13 7.8.1 General.13 7.8.2 Requirements for recording data .13 7.8.3 Requirements for calculating results 13 7.8.4 Requirements for reporting results 14 7.9 Execution sequence .15 7.9.1 General.15 7.9.2 Pre-test act
13、ivities 15 7.9.3 Test activities .15 7.9.4 Post-test activities16 ISO/IEC 2015 All rights reserved iii Contents PageBS ISO/IEC 29197:2015ISO/IEC 29197:2015(E)8 Operational evaluation .17 8.1 Introduction .17 8.2 Environment 17 8.3 Test period .17 8.4 Data recording processes 17 8.5 Performance measu
14、rements 18 8.6 Impostor transactions .18 8.7 Reporting 18 Annex A (informative) Values for environmental parameters .19 Annex B (informative) Test equipment .21 Bibliography .23 iv ISO/IEC 2015 All rights reservedBS ISO/IEC 29197:2015ISO/IEC 29197:2015(E) Foreword ISO (the International Organization
15、 for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective
16、 organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information te
17、chnology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. The procedures used to develop this document and those intended for its further maintenance are described in the ISO/IEC Directives, Part 1. In particular the different approval criteria needed for the different types
18、 of document should be noted. This document was drafted in accordance with the editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives). Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO and IEC shall not b
19、e held responsible for identifying any or all such patent rights. Details of any patent rights identified during the development of the document will be in the Introduction and/or on the ISO list of patent declarations received (see www.iso.org/patents). Any trade name used in this document is infor
20、mation given for the convenience of users and does not constitute an endorsement. For an explanation on the meaning of ISO specific terms and expressions related to conformity assessment, as well as information about ISOs adherence to the WTO principles in the Technical Barriers to Trade (TBT), see
21、the following URL: Foreword Supplementary information. The committee responsible for this document is ISO/IEC JTC 1, Information technology, SC 37, Biometrics. ISO/IEC 2015 All rights reserved vBS ISO/IEC 29197:2015ISO/IEC 29197:2015(E) Introduction The performance of biometric systems can vary acco
22、rding to environmental conditions (see e.g. ISO/IEC 19795-1:2006, C.2.6, ISO/IEC TR 19795-3:2007, Table 4). Environmental conditions can affect subjects ease of use and comfort in using the systems, subjects biometric characteristics, and also the devices used for acquisition of biometric samples. T
23、his International Standard provides a generic methodology to analyse the influence of environmental conditions on biometric system performance. NOTE Environmental conditions can affect several elements involved in the recognition process. However, the proposed evaluation methodology does not disting
24、uish which of them is affected. The intention of this methodology is to quantify the overall influence analysing the biometric system performance. For this International Standard, environmental conditions has to be understood as all atmospheric parameters (e.g. temperature, humidity) and other physi
25、cal and chemical phenomena (e.g. illumination, noise) that can surround the biometric system and influence in its performance. Certain environmental conditions such as vibration are not dealt with in this International Standard. These evaluations consist of carrying out a similar “end-to-end” biomet
26、ric performance evaluation in one or more predefined environments. These environments can be real (naturally occurring) or modelled (artificially controlled). There are two possible ways to carry out an “end-to-end” biometric performance evaluation: performing scenario evaluations or operational eva
27、luations. In scenario evaluations, biometric systems are assessed in modelled environments considering a real-world target application and population. These evaluations are specified as a special case of scenario test based on ISO/IEC 19795-2. An evaluation performed in a controlled environment can
28、be reproducible, unlike in an operational environment which uncontrolled parameters can affect the system. In operational evaluations, biometric systems are analysed in real environments using a target population. These evaluations are specified as a special case of operational evaluations based on
29、ISO/IEC 19795-6. Operational testing can lack the precision of scenario testing (in terms of the levels of the environmental parameters), but the testing will benefit in terms of being operationally realistic. This International Standard provides testing requirements specific to environmental testin
30、g for both kinds of evaluations. The methodology addresses how to test several environmental factors; however, an evaluation that conforms to this International Standard can consider as few as one single environmental parameter. The test parameter or parameters to assess and control has to be previo
31、usly defined by participants involved in the evaluation. The targets of this kind of evaluations include: Analyse how one or a combination of environmental factors can affect the biometric system performance and quantify this influence. Analyse how a biometric system works in a specific controlled e
32、nvironment, compared to the same system working in a reference evaluation environment. Analyse how a biometric system behaves in a real environment compared to the same system working in a modelled environment simulating the operational environment. The results of these evaluations can inform suppli
33、ers and users so that they can assess which environmental conditions are likely to affect the performance of a biometric system under conditions they expect to encounter. Results can also indicate whether the particular biometric modality and method of implementation is appropriate for the situation
34、 under which the system is expected to be used. Also this methodology can be used for examining environmental parameters under which biometric systems poorly.vi ISO/IEC 2015 All rights reservedBS ISO/IEC 29197:2015Information technology Evaluation methodology for environmental influence in biometric
35、 system performance 1 Scope This International Standard addresses fundamental requirements for planning and execution of environmental performance evaluations for biometric systems based on scenario and operational test methodologies, specifications to define, establish, and measure specific conditi
36、ons to assess, including requirements for equipment, requirements for establishing a baseline performance in order to compare the influence of environmental parameters, a specification of the biometric evaluation including requirements for test population, test protocols, data to record, and test re
37、sults, and procedures for carrying out the overall evaluation. This International Standard does not determine which parameters should be analysed for a specific biometric modality (This is currently covered in ISO/IEC/TR 19795-3.), specify requirements to perform a vulnerability analysis modifying e
38、nvironmental factors (This is covered by ISO/IEC 19792.), classify biometric systems upon performance against different environmental conditions, or specify requirements for determining the functional effects of environmental conditions on hardware components (such as corrosion, electrical interfere
39、nce, breakage, etc.) of biometric systems. 2 Conformance Environmental tests of biometric systems shall be based on scenario evaluations or operational evaluations. Scenario evaluations shall conform with mandatory requirements of Clause 7 whereas operational evaluations shall conform with mandatory
40、 requirements of Clause 8. Further, a scenario evaluation that conforms to this International Standard shall analyse at least two evaluation conditions: the reference evaluation environment and one target evaluation environment. Both shall consider at least one environmental parameter to assess such
41、 as temperature, humidity, illumination, etc. These evaluation conditions shall be selected, specified, measured, and recorded in accordance with Clause 6. 3 Normative references The following documents, in whole or in part, are normatively referenced in this document and are indispensable for its a
42、pplication. For dated references, only the edition cited applies. For undated references, the latest edition of the referenced document (including any amendments) applies. ISO/IEC 19795-1:2006, Information technology Biometric performance testing and reporting Part 1: Principles and framework INTERN
43、ATIONAL ST ANDARD ISO/IEC 29197:2015(E) ISO/IEC 2015 All rights reserved 1BS ISO/IEC 29197:2015ISO/IEC 29197:2015(E) ISO/IEC 19795-2, Information technology Biometric performance testing and reporting Part 2: Testing methodologies for technology and scenario evaluation ISO/IEC 19795-6, Information t
44、echnology Biometric performance testing and reporting Part 6: Testing methodologies for operational evaluation 4 Terms and definitions For the purposes of this document, the terms and definitions given in ISO/IEC 19795-1 and the following apply. 4.1 ambient conditions real environment common, prevai
45、ling, and uncontrolled atmospheric and weather conditions in a room or place Note 1 to entry: A test described as “conducted at ambient conditions” was performed at whatever conditions were prevailing at that time on that day. 4.2 baseline performance performance of a biometric system in a reference
46、 evaluation environment 4.3 controlled conditions climatic and physical conditions that are constrained or managed or kept within certain bounds for the testing purpose 4.4 environment generator specialized test equipment used to establish and maintain the controlled conditions of the test 4.5 envir
47、onmental conditions all atmospheric parameters (e.g. temperature, humidity) and other physical and chemical phenomena (e.g. illumination) that can surround the biometric system and influence in its performance Note 1 to entry: These can be controlled or ambient. 4.6 evaluation condition environmenta
48、l condition under which an evaluation is executed 4.7 evaluation configuration physical layout of the environment in which the biometric system is going to be tested including the necessary equipment and test instruments for performing tests 4.8 evaluation environment environment in which the biomet
49、ric system is evaluated considering the environmental conditions and the evaluation configuration 4.9 extreme condition condition that entails very high or very low values of the environmental parameters and may be hostile for systems operation or even human life2 ISO/IEC 2015 All rights reservedBS ISO/IEC 29197:2015ISO/IEC 29197:2015(E) 4.10 instrument calibrated equipment used to measure and/or record environmental parameters (such as temperature, humidity, ill
