BS ISO IEC 25066-2016 Systems and software engineering Systems and software Quality Requirements and Evaluation (SQuaRE) Common Industry Format (CIF) for Usability Evaluat.pdf

1、BS ISO/IEC 25066:2016 Systems and software engineering Systems and software Quality Requirements and Evaluation (SQuaRE) Common Industry Format (CIF) for Usability Evaluation Report BSI Standards Publication WB11885_BSI_StandardCovs_2013_AW.indd 1 15/05/2013 15:06BS ISO/IEC 25066:2016 BRITISH STANDA

2、RD National foreword This British Standard is the UK implementation of ISO/IEC 25066:2016. The UK participation in its preparation was entrusted to Technical Committee IST/15, Software and systems engineering. A list of organizations represented on this committee can be obtained on request to its se

3、cretary. This publication does not purport to include all the necessary provisions of a contract. Users are responsible for its correct application. The British Standards Institution 2016. Published by BSI Standards Limited 2016 ISBN 978 0 580 84152 1 ICS 35.080 Compliance with a British Standard ca

4、nnot confer immunity from legal obligations. This British Standard was published under the authority of the Standards Policy and Strategy Committee on 30 June 2016. Amendments/corrigenda issued since publication Date T e x t a f f e c t e dBS ISO/IEC 25066:2016 Systems and software engineering Syste

5、ms and software Quality Requirements and Evaluation (SQuaRE) Common Industry Format (CIF) for Usability Evaluation Report Ingnierie des systmes et du logiciel Exigences de qualit et valuation des systmes et du logiciel (SQuaRE) Format de lindustrie commune pour lutilisation Rapport dvaluation INTERN

6、ATIONAL STANDARD ISO/IEC 25066 Reference number ISO/IEC 25066:2016(E) First edition 2016-06-15 ISO/IEC 2016 BS ISO/IEC 25066:2016ii ISO/IEC 2016 All rights reserved COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2016, Published in Switzerland All rights reserved. Unless otherwise specified, no part of this pu

7、blication may be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below or ISOs member body in the co

8、untry of the requester. ISO copyright office Ch. de Blandonnet 8 CP 401 CH-1214 Vernier, Geneva, Switzerland Tel. +41 22 749 01 11 Fax +41 22 749 09 47 copyrightiso.org www.iso.org ISO/IEC 25066:2016(E)BS ISO/IEC 25066:2016ISO/IEC 25066:2016(E)Foreword iv Introduction v 1 Scope . 1 2 Conformance . 1

9、 3 T erms and definitions . 1 4 Purpose and types of usability evaluations 6 4.1 Purpose of an evaluation 6 4.2 Types of usability evaluations . 6 4.3 Assessing conformity of the object of evaluation against specified criteria 7 5 Content elements of usability evaluation reports . 9 5.1 Selecting co

10、ntent elements . 9 5.2 Description of the content elements for each type of evaluation .10 5.2.1 Executive summary (if used) 10 5.2.2 Description of the object of evaluation 10 5.2.3 Purpose of the evaluation .11 5.2.4 Method .12 5.2.5 Procedure 17 5.2.6 Results 22 5.2.7 Interpretation of results an

11、d recommendations .24 5.2.8 Additional content for conformity assessment (as part of a usability evaluation report) 25 Annex A (normative) Overview on required and recommended content elements for each type of evaluation .26 Annex B (informative) Usability test report example 29 Bibliography .37 ISO

12、/IEC 2016 All rights reserved iii Contents PageBS ISO/IEC 25066:2016ISO/IEC 25066:2016(E) Foreword ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are memb

13、ers of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international org

14、anizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. The procedures used to develop this document and those intended for its further mai

15、ntenance are described in the ISO/IEC Directives, Part 1. In particular the different approval criteria needed for the different types of document should be noted. This document was drafted in accordance with the editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives). Attenti

16、on is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. Details of any patent rights identified during the development of the document will be in the Introd

17、uction and/or on the ISO list of patent declarations received (see www.iso.org/patents). Any trade name used in this document is information given for the convenience of users and does not constitute an endorsement. For an explanation on the meaning of ISO specific terms and expressions related to c

18、onformity assessment, as well as information about ISOs adherence to the WTO principles in the Technical Barriers to Trade (TBT), see the following URL: Foreword Supplementary information. The committee responsible for this document is ISO/TC 159, Ergonomics, Subcommittee SC 4, Ergonomics of human-s

19、ystem interaction and Joint Technical Committee ISO/IEC JTC 1, Information technology, Subcommittee SC 7, Software and system engineering.iv ISO/IEC 2016 All rights reservedBS ISO/IEC 25066:2016ISO/IEC 25066:2016(E) Introduction The human-centred design approach of ISO 9241-210 is well established a

20、nd focuses specifically on making systems usable. Usability can be achieved by applying human-centred design throughout the lifecycle. In order to enable a human-centred approach to be adopted, it is important that all the relevant types of information related to usability (information items) are id

21、entified and communicated. The identification and communication of relevant types of information related to usability enables the design and testing of the usability of a system. This International Standard provides a framework and consistent terminology for reporting the evaluation of an interactiv

22、e system. It is intended to assist usability specialists and developers in documenting and communicating usability-related information as part of the system development lifecycle. The Common Industry Format (CIF) for Usability family of International Standards is described in ISO/IEC TR 25060 and is

23、 part of the SQuaRE (Systems and software Quality Requirements and Evaluation) series of standards on systems and software product quality requirements and evaluation (ISO/IEC 25000 1) , ISO/IEC 25001, ISO/IEC 25021 2) , ISO/IEC 25023 3) , ISO/IEC 25040, ISO/IEC 25041 and ISO/IEC 25051). The CIF fam

24、ily of standards uses definitions that are consistent with the ISO 9241 series of standards (Ergonomics of human-system interaction), as this is the terminology that is normally used for this subject matter. In some cases, these definitions differ from those in ISO/IEC 25000. CIF standards are publi

25、shed or planned for the following information items: Common Industry Format (CIF) for usability test reports (ISO/IEC 25062); NOTE ISO/IEC 25062 provides more detail for the content of a user observation report for performance measurement. Context of use description (ISO/IEC 25063); User needs repor

26、t (ISO/IEC 25064); User requirements specification (ISO/IEC 25065); Evaluation reports (ISO/IEC 25066); User interaction specification (planned); User interface specification (planned); Field data report (planned). The CIF standards are part of the “Extension Division” of the ISO/IEC 25000 SQuaRE se

27、ries of International Standards. Table 1 presents an overview of the structure and the contents of the SQuaRE series of International Standards. 1) Withdrawn. 2) Withdrawn. 3) Under development. ISO/IEC 2016 All rights reserved vBS ISO/IEC 25066:2016ISO/IEC 25066:2016(E) Table 1 Organization of SQua

28、RE series of International Standards SQuaRE Architecture and Sub-projects ISO/IEC 2503n: Quality Requirement Division ISO/IEC 2501n: Quality Model Division ISO/IEC 2504n: Quality Evaluation Division ISO/IEC 2500n: Quality Management Division ISO/IEC 2502n: Quality Measurement Division ISO/IEC 25050

29、25099 SQuaRE Extension Division ISO/IEC 25051: Requirements for quality of Ready to Use Software Product (RUSP) and instructions for testing ISO/IEC 2506n Common Industry Format Division Figure 1 Relationship of CIF documents to human-centred design in ISO 9241-210 and system lifecycle processes in

30、ISO/IEC 15288 Figure 1 illustrates the interdependence of these information items with the human-centred design activities described in ISO 9241-210, as well as the corresponding System Life Cycle processes described in ISO/IEC 15288 4) . The following discussion also serves as alternative text for

31、the figure. The figure depicts the activities as a set of intersecting circles. The circles overlap to represent that the activities are not separate, but rather overlapping in time and scope, and the outcome of each activity provides the input to one or more other activities. As each human-centred

32、design activity can provide input to any other, no starting point, end point, or linear process is intended. 4) Withdrawn. Replaced with ISO/IEC/IEEE 15288:2015.vi ISO/IEC 2016 All rights reservedBS ISO/IEC 25066:2016ISO/IEC 25066:2016(E) The human-centred design is composed of four interacting acti

33、vities represented as overlapping circles in the diagram where User Needs are at the centre. The first activity involves Context of Use. Human-centred design relies on user needs that are first identified during of the Context of Use analysis. User needs are documented in the User needs report (ISO/

34、IEC 25064), which is an intermediate deliverable that links the Context of Use Description (ISO/IEC 25063) that contains information about the users, their tasks and the organizational and physical environment, to the user requirements. These items are developed during the Stakeholders requirements

35、definition process described in ISO/IEC 15288. The second activity involves Derived Requirements. The User requirements specification (ISO/IEC 25065) provides the basis for design and evaluation of interactive systems to meet the user needs. User requirements are developed in conjunction with and fr

36、om part of the overall requirements specification of an interactive system. The third activity involves Designed Solutions. The “Produce design solutions” activity focuses on designing user interaction that meets user requirements. This activity takes place during the Architectural Design, Implement

37、ation, and Integration processes described in ISO/IEC 15288 and produces the information items “User interaction specification” and the “User interface specification”. The fourth activity involves Evaluation Results. The “Evaluate” activity starts at the earliest stages in the project, evaluating de

38、sign concepts to obtain a better understanding of the user needs. Design solutions can be evaluated multiple times as the interactive system is being developed and can produce various types of evaluation reports and usability data such as that described in ISO/IEC 25062. These evaluations can suppor

39、t the ISO/IEC 15288 Validation Process that confirms that the system complies with the stakeholders requirements. ISO/IEC 2016 All rights reserved viiBS ISO/IEC 25066:2016BS ISO/IEC 25066:2016Systems and software engineering Systems and software Quality Requirements and Evaluation (SQuaRE) Common In

40、dustry Format (CIF) for Usability Evaluation Report 1 Scope This International Standard describes the Common Industry Format (CIF) for reporting usability evaluations. It provides a classification of evaluation approaches and the specifications for the content items (content elements) to be included

41、 in an evaluation report based on the selected evaluation approach(es). The intended users of the usability evaluation reports are identified, as well as the situations in which the usability evaluation report can be applied. The usability evaluation reports in this International Standard are applic

42、able to software and hardware systems, products or services used for predefined tasks (excluding generic products, such as a display screen or a keyboard). The content elements are intended to be used as part of system- level documentation resulting from development processes such as those in ISO 92

43、41-210 and ISO/IEC JTC 1/SC 7 process standards. The content elements for documenting evaluations can be integrated in any type of process model. NOTE For the purpose of establishing process models, ISO/IEC TR 24774 and ISO/IEC 33020 specify the format and conformance requirements for process models

44、 respectively. In addition, ISO/IEC 15289 defines the types and content of information items developed and used in process models for system and software lifecycle management. ISO/IEC 15504-5 and ISO/IEC 15504-6 (to be replaced by ISO/IEC 33060) define work products, including information items, fo

45、r the purpose of process capability assessment. Process models and associated information items for human-centred design of interactive systems are contained in ISO/TR 18529 and ISO/TS 18152. 2 Conformance An evaluation report conforms to this International Standard if it contains all the required c

46、ontent elements in Clause 5 that are applicable to the type(s) of evaluation, including: additional optional content elements that were selected to be part of the evaluation; the content elements for the conformity assessment (if used). 3 T erms a nd definiti ons For the purposes of this document, t

47、he following terms and definitions apply. NOTE The CIF family of standards uses definitions that are consistent with the ISO 9241 series of standards, as this is the terminology that is normally used for this subject matter. In some cases, these definitions differ from those in ISO/IEC 25000. 3.1 ac

48、cessibility extent to which products, systems, services, environments and facilities can be used by people from a population with the widest range of characteristics and capabilities to achieve a specified goal in a specified context of use Note 1 to entry: Context of use includes direct use or use

49、supported by assistive technologies. SOURCE: ISO 26800:2011, 2.1; modified, Note 2 to entry deleted INTERNATIONAL ST ANDARD ISO/IEC 25066:2016(E) ISO/IEC 2016 All rights reserved 1BS ISO/IEC 25066:2016ISO/IEC 25066:2016(E) 3.2 action user behaviour that a system accepts as a request for a particular operation SOURCE: ISO/IEC TR 11580:2007, 2.3; modified, Example deleted 3.3 conformity assessment demonstration that specified requirements relating to a pro