1、raising standards worldwide NO COPYING WITHOUT BSI PERMISSION EXCEPT AS PERMITTED BY COPYRIGHT LAW BSI Standards Publication BS ISO/IEC 25040:2011 Systems and software engineering Systems and software Quality Requirements and Evaluation (SQuaRE) Evaluation process BS ISO/IEC 25040:2011 BRITISH STAND
2、ARD National foreword This British Standard is the UK implementation of ISO/IEC 25040:2011. It supersedes BS ISO/IEC 14598-1:1999 which is withdrawn. The UK participation in its preparation was entrusted to Technical Committee IST/15, Software and systems engineering. A list of organizations represe
3、nted on this committee can be obtained on request to its secretary. This publication does not purport to include all the necessary provisions of a contract. Users are responsible for its correct application. BSI 2011 ISBN 978 0 580 68283 4 ICS 35.080 Compliance with a British Standard cannot confer
4、immunity from legal obligations. This British Standard was published under the authority of the Standards Policy and Strategy Committee on 31 March 2011. Amendments issued since publication Date Text affectedBS ISO/IEC 25040:2011Reference number ISO/IEC 25040:2011(E) ISO/IEC 2011INTERNATIONAL STANDA
5、RD ISO/IEC 25040 First edition 2011-03-01 Systems and software engineering Systems and software Quality Requirements and Evaluation (SQuaRE) Evaluation process Ingnierie des systmes et du logiciel Exigences de qualit et valuation des systmes et du logiciel (SQuaRE) Modle de rfrence dvaluation et gui
6、de BS ISO/IEC 25040:2011 ISO/IEC 25040:2011(E) PDF disclaimer This PDF file may contain embedded typefaces. In accordance with Adobes licensing policy, this file may be printed or viewed but shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer per
7、forming the editing. In downloading this file, parties accept therein the responsibility of not infringing Adobes licensing policy. The ISO Central Secretariat accepts no liability in this area. Adobe is a trademark of Adobe Systems Incorporated. Details of the software products used to create this
8、PDF file can be found in the General Info relative to the file; the PDF-creation parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In the unlikely event that a problem relating to it is found, please inform the Central
9、 Secretariat at the address given below. COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2011 All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permissio
10、n in writing from either ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.org Published in Switzerland ii ISO/IEC 2011 All rights reser
11、vedBS ISO/IEC 25040:2011 ISO/IEC 25040:2011(E) ISO/IEC 2011 All rights reserved iiiContents Page Foreword iv Introduction.v 1 Scope1 2 Conformance .1 3 Normative references1 4 Terms and definitions .1 5 Software product quality evaluation reference model 10 5.1 Reference model - general .10 5.2 Refe
12、rence model - evaluation processes11 5.3 Roles.13 5.4 Quality in the life cycle13 5.5 Support for the evaluation13 6 Software product quality evaluation process 14 6.1 General requirements .14 6.2 Documentation 14 6.3 Establish the evaluation requirements .15 6.4 Specify the evaluation.17 6.5 Design
13、 the evaluation .19 6.6 Execute the evaluation20 6.7 Conclude the evaluation.21 Annex A (informative) Evaluation levels.25 Annex B (informative) Evaluation methods29 Annex C (informative) Example of Cost-Effectiveness Ranking of Evaluation Methods 34 Annex D (informative) Relationships between softw
14、are product quality evaluation process reference model and software and system life cycle processes .35 Annex E (informative) Evaluation report template 37 Annex F (informative) Diagrams of inputs, outcomes, constraints and resources for activities.39 Bibliography44 BS ISO/IEC 25040:2011 ISO/IEC 250
15、40:2011(E) iv ISO/IEC 2011 All rights reservedForeword ISO (the International Organization for Standardization) and IEC (the International Electro technical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC participate in the develo
16、pment of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmental and non-government
17、al, in liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2. The main task of the
18、 joint technical committee is to prepare International Standards. Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as an International Standard requires approval by at least 75 % of the national bodies casting a vote. At
19、tention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. ISO/IEC 25040 is part of the SQuaRE series of standards and was prepared by Joint Technical Com
20、mittee ISO/IEC JTC 1, Information technology, Subcommittee SC 7, Software and systems engineering. BS ISO/IEC 25040:2011 ISO/IEC 25040:2011(E) ISO/IEC 2011 All rights reserved vIntroduction As the use of information technology grows, the number of critical computer systems also grows. Such systems i
21、nclude, for example, security critical, life critical, economically critical and safety critical systems. The quality of software in these systems is particularly important because software faults can lead to serious consequences. Evaluation is the systematic determination of the extent to which an
22、entity meets its specified criteria. The evaluation of software product quality is vital to both the acquisition and development of software. The relative importance of the various characteristics of software quality depends on the intended usage or objectives of the system of which the software is
23、a part; software products need to be evaluated to decide whether relevant quality characteristics meet the requirements of the system. This document is part of the SQuaRE series of standards and contains general requirements for software product quality evaluation as well as clarifies the associated
24、 general concepts. The general goal of creating the SQuaRE set of standards is to move to a logically organized, enriched and unified series covering two main processes: software quality requirements specification and software quality evaluation, supported by a software quality measurement process.
25、The purpose of the SQuaRE set of standards is to assist those developing and acquiring software products with the specification and evaluation of quality requirements. It establishes criteria for the specification of software product quality requirements, their measurement, and evaluation. It includ
26、es a quality model for aligning customer definitions of quality with attributes of the development process. In addition, the series provides recommended measures of software product quality attributes that can be used by developers, acquirers, and evaluators. SQuaRE provides terms and definitions, r
27、eference models, general guide, individual division guides, and standards for requirements specification, planning and management, measurement and evaluation purposes. SQuaRE includes International Standards on quality model and measures, as well as on quality requirements and evaluation. SQuaRE rep
28、laces the current ISO/IEC 9126 series and the ISO/IEC 14598 series. This International Standard is intended to be used in conjunction with the other parts of the SQuaRE series of standards, and with the ISO/IEC 14598 series and the ISO/IEC 9126 series until superseded by the ISO/IEC 25000 series of
29、standards. The SQuaRE series of standards consists of the following divisions under the general title Systems and software product Quality Requirements and Evaluation: ISO/IEC 2500n - Quality Management Division, ISO/IEC 2501n - Quality Model Division, BS ISO/IEC 25040:2011 ISO/IEC 25040:2011(E) vi
30、ISO/IEC 2011 All rights reserved ISO/IEC 2502n - Quality Measurement Division, ISO/IEC 2503n - Quality Requirements Division, and ISO/IEC 2504n - Quality Evaluation Division. Annex A provides an explanation on levels of evaluation, aspects to be considered when defining evaluation levels and suggest
31、ions on evaluation techniques to be applied according to the rank of evaluation level. Annex B provides examples of evaluation methods. Annex C provides a table showing relationships between some evaluation methods, possible cost rank and effectiveness per software quality characteristics. Annex D p
32、rovides relationships between the software product quality evaluation process reference model and the software and system life cycle processes. Annex E provides an example template of an evaluation report. Annex F provides the diagrams of inputs, outcomes, constraints and resources for each evaluati
33、on activity. Figure 1 illustrates the organization of the SQuaRE series representing families of standards, further called Divisions. 2503n Quality Model Division 2501n Quality Requirements Division 2503n 2504n Quality Evaluation Division 2504n Quality Measurement Division Quality Management Divisio
34、n 2500n Extension Division 25050 - 25099 2502nFigure 1 Organization of the SQuaRE series of International Standards The Divisions within the SQuaRE model are as follows. ISO/IEC 2500n - Quality Management Division. The International Standards that form this division define all common models, terms a
35、nd definitions referred to by all other standards from the SQuaRE series. Referring paths (guidance through SQuaRE documents) and high-level practical suggestions in applying proper standards to specific application cases offer help to all types of users. The division also provides requirements and
36、guidance for a supporting function which is responsible for the management of software product requirements, specification and evaluation. BS ISO/IEC 25040:2011 ISO/IEC 25040:2011(E) ISO/IEC 2011 All rights reserved vii ISO/IEC 2501n - Quality Model Division. The International Standard that forms th
37、is division presents detailed quality models for software, quality in use and data. Practical guidance on the use of the quality model is also provided. ISO/IEC 2502n - Quality Measurement Division. The International Standards that form this division include a software product quality measurement re
38、ference model, mathematical definitions of quality measures, and practical guidance for their application. This division presents internal measures of software quality, external measures of software quality and quality in use measures. Quality measure elements (QME) forming foundations for the latte
39、r measures are defined and presented. ISO/IEC 2503n - Quality Requirements Division. The International Standard that forms this division helps specifying quality requirements. These quality requirements can be used in the process of quality requirements, elicitation for a software product to be deve
40、loped or as inputs for an evaluation process. The requirements definition process is mapped to technical processes defined in ISO/IEC 15288. ISO/IEC 2504n - Quality Evaluation Division. The International Standards that form this division provide requirements, recommendations and guidelines for softw
41、are product evaluation, whether performed by independent evaluators, acquirers or developers. The support for documenting a measure as an evaluation module is also presented. ISO/IEC 25050 to ISO/IEC 25099 are reserved to be used for SQuaRE extension International Standards and/or Technical Reports.
42、 This International Standard is part of the 2504n series on quality evaluation division that currently consists of the following International Standards: ISO/IEC 25040 - Evaluation process: contains general requirements for specification and evaluation of software quality and clarifies the general c
43、oncepts. Provides a process description for evaluating quality of software product and states the requirements for the application of this process. The evaluation process is the basis for software product quality evaluation for different purposes and approaches. Therefore, the process can be used fo
44、r the evaluation of quality in use, external measure of software quality and internal measure of software quality and can be applied to evaluate the quality of pre-developed software or custom software during its development process. The software product quality evaluation can be conducted, for inst
45、ance, by an acquirer, a developer organization, or an independent evaluator. ISO/IEC 25041 - Evaluation guides for developers, acquirers and evaluators: contains specific requirements and recommendations for developers, acquirers and evaluators. ISO/IEC 25042 - Evaluation modules: defines the struct
46、ure and content of the documentation to be used to describe an evaluation module. These evaluation modules contain the specification of the quality model (i.e. characteristics, subcharacteristics and corresponding internal, external or quality in use measures), the associated data and information ab
47、out the planned application of the model and the information about its actual application. Appropriate evaluation modules are selected for each evaluation. In some cases it may be necessary to develop new evaluation modules. Guidance for developing new evaluation modules is found in ISO/IEC 25042. T
48、his International Standard can also be used by organizations producing new evaluation modules. ISO/IEC 25045 - Evaluation module for recoverability: provides the specification to evaluate the subcharacteristic of recoverability defined under the characteristic of reliability of the quality model. It
49、 determines the external measures of software quality of resiliency and autonomic recovery index when the information system composed of one or more software products execution transactions is subjected to a series of disturbances. A disturbance could be an operational fault (e.g. an abrupt shutdown of an OS process that brings down a system) or an event (e.g. a significant increase of users to the system). ISO/IEC 25040 is a revised version and replaces the current ISO/IEC 14598-1. BS ISO/IEC 250
