1、 Reference number ISO/IEC 25041:2012(E) ISO/IEC 2012INTERNATIONAL STANDARD ISO/IEC 25041 First edition 2012-10-15 Systems and software engineering Systems and software Quality Requirements and Evaluation (SQuaRE) Evaluation guide for developers, acquirers and independent evaluators Ingnierie des sys
2、tmes et du logiciel Exigences de qualit et valuation des systmes et du logiciel (SQuaRE) Guide dvaluation pour les dveloppeurs, les acqureurs et les valuateurs indpendants ISO/IEC 25041:2012(E) COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2012 All rights reserved. Unless otherwise specified, no part of this
3、 publication may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Case postale 56 CH-1211
4、 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.org Published in Switzerland ii ISO/IEC 2012 All rights reservedISO/IEC 25041:2012(E) ISO/IEC 2012 All rights reserved iiiContents Page Foreword . v Introduction vi 1 Scope 1 2 Conformance . 1 3 Normative ref
5、erences 1 4 Terms and definitions . 2 5 Concept of evaluation from the viewpoint of each role 3 5.1 Framework of the product quality evaluation from the perspective of each role. 3 5.2 Target entity of software product quality evaluation . 4 5.3 Roles and responsibilities 6 5.3.1 Roles and responsib
6、ilities of developers . 6 5.3.2 Roles and responsibilities of acquirers 6 5.3.3 Roles and responsibilities of independent evaluators 7 6 Organization level requirements and recommendations for software product quality evaluation . 7 6.1 General requirements and recommendations 7 6.2 Documentation of
7、 software product quality evaluation 8 6.3 Organization level requirements and recommendations to support each role 9 6.3.1 General requirements . 9 6.3.2 Organizational level recommendations for developers 10 6.3.3 Organization level requirements and recommendations for acquirers . 10 6.3.4 Organiz
8、ation level requirements for independent evaluators 11 7 Requirements and recommendation for developers evaluation process . 11 7.1 General requirements . 11 7.2 Establish the evaluation requirements . 12 7.2.1 Inputs and outcomes of this process 12 7.2.2 Establish the purpose of the evaluation . 12
9、 7.2.3 Obtain the software product quality requirements 13 7.2.4 Identify product parts to be included in the evaluation 14 7.2.5 Define the stringency of the evaluation 15 7.3 Specify the evaluation . 15 7.3.1 Inputs and outcomes of this process 15 7.3.2 Select quality measures (evaluation modules)
10、 16 7.3.3 Define decision criteria for quality measures 18 7.3.4 Define decision criteria for evaluation 18 7.4 Design the evaluation . 19 7.4.1 Inputs and outcomes of this process 19 7.4.2 Plan evaluation activities 19 7.5 Execute the evaluation 21 7.5.1 Inputs and outcomes of this process 21 7.5.2
11、 Make measurements . 22 7.5.3 Apply decision criteria for quality measures . 23 7.5.4 Apply decision criteria for evaluation . 23 7.6 Conclude the evaluation . 24 7.6.1 Inputs and outcomes of this process 24 7.6.2 Review the evaluation results 25 7.6.3 Create the evaluation report . 26 7.6.4 Review
12、quality evaluation and provide feedback to the organization . 28 ISO/IEC 25041:2012(E) iv ISO/IEC 2012 All rights reserved7.6.5 Perform disposition of evaluation data .28 8 Requirements and recommendations for acquirers evaluation process 29 8.1 General requirements 29 8.2 Establish the evaluation r
13、equirements 29 8.2.1 Inputs and outcomes of this process 29 8.2.2 Establish the purpose of the evaluation .30 8.2.3 Obtain the software product quality requirements 34 8.2.4 Identify product parts to be included in the evaluation .34 8.2.5 Define the stringency of the evaluation 35 8.3 Specify the e
14、valuation .36 8.3.1 Inputs and outcomes of this process 36 8.3.2 Select quality measures (evaluation modules) .37 8.3.3 Define decision criteria for quality measures .38 8.3.4 Define decision criteria for evaluation 38 8.4 Design the evaluation 38 8.4.1 Inputs and outcomes of this process 38 8.4.2 P
15、lan evaluation activities 39 8.5 Execute the evaluation 40 8.5.1 Inputs and outcomes of this process 40 8.5.2 Make measurements .40 8.5.3 Apply decision criteria for quality measures 41 8.5.4 Apply decision criteria for evaluation41 8.6 Conclude the evaluation .42 8.6.1 Inputs and outcomes of this p
16、rocess 42 8.6.2 Review the evaluation result 42 8.6.3 Create the evaluation report .42 8.6.4 Review quality evaluation and provide feedback to the organization .42 8.6.5 Perform disposition of evaluation data .42 9 Requirements and recommendations for independent evaluators evaluation process 42 9.1
17、 General requirements 42 9.2 Establish the evaluation requirements 45 9.2.1 Inputs and outcomes of this process 45 9.2.2 Establish the purpose of the evaluation .45 9.2.3 Obtain the software product quality requirements 45 9.2.4 Identify products parts to be included in the evaluation .45 9.2.5 Defi
18、ne the stringency of the evaluation 47 9.3 Specify the evaluation .47 9.3.1 Inputs and outcomes of this process 47 9.3.2 Select quality measures (evaluation modules) .47 9.3.3 Define decision criteria for quality measures .48 9.3.4 Define decision criteria for evaluation 48 9.4 Design the evaluation
19、 48 9.4.1 Inputs and outcomes of this process 48 9.4.2 Plan evaluation activities 48 9.5 Execute the evaluation 49 9.5.1 Inputs and outcomes of this process 49 9.5.2 Make measurements .49 9.5.3 Apply decision criteria for quality measures 50 9.5.4 Apply decision criteria for evaluation50 9.6 Conclud
20、e the evaluation .50 9.6.1 Inputs and outcomes of this process 50 9.6.2 Review the evaluation result 50 9.6.3 Create the evaluation report .50 9.6.4 Review quality evaluation and provide feedback to the organization .50 9.6.5 Perform disposition of evaluation data .51 Bibliography 52 ISO/IEC 25041:2
21、012(E) ISO/IEC 2012 All rights reserved vForeword ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC participate in the development
22、of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, in
23、 liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2. The main task of the joint
24、 technical committee is to prepare International Standards. Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as an International Standard requires approval by at least 75 % of the national bodies casting a vote. Attentio
25、n is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. ISO/IEC 25041 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology, Subcom
26、mittee SC 7, Software and systems engineering. This first edition of ISO/IEC 25041 cancels and replaces ISO/IEC 14598-3:2000, ISO/IEC 14598-4:1999 and ISO/IEC 14598-5:1998. ISO/IEC 25041:2012(E) vi ISO/IEC 2012 All rights reservedIntroduction As the use of information technology grows, the number of
27、 critical systems also grows. Such systems include, for example, security critical, life critical, economically critical and safety critical systems. The quality of systems and software product of such critical systems is particularly important because software faults may lead to serious consequence
28、s. Evaluation is the systematic determination of the extent to which an entity meets its specified criteria. The evaluation of product quality is vital to both the acquisition and development of software. The relative importance of the various characteristics of software quality depends on the inten
29、ded usage or objectives of the system of which the software is a part; products need to be evaluated to decide whether relevant quality characteristics meet the requirements of the system. This International Standard is part of the ISO/IEC 250nn SQuaRE series of standards. ISO/IEC 25040 contains gen
30、eral requirements and recommendations for product quality evaluation as well as associated general concepts. This International Standard provides specific issues related to the developers, acquirers and independent evaluators based on ISO/IEC 25040. The general goal of creating the SQuaRE set of sta
31、ndards is to move to a logically organized, enriched and unified series covering two main processes: software quality requirements specification and software quality evaluation, supported by a software quality measurement process. The purpose of the SQuaRE set of standards is to assist those develop
32、ing and acquiring products with the specification and evaluation of quality requirements. It establishes criteria for the specification of product quality requirements, their measurement, and evaluation. It includes a quality model for aligning customer definitions of quality with properties of the
33、development process. In addition, the series provides recommended measures of product properties that can be used by developers, acquirers, and independent evaluators. SQuaRE provides: terms and definitions; reference models; general guide; individual division guides, and standards for requirements
34、specification, planning and management, measurement and evaluation purposes. SQuaRE includes International Standards on quality modes and measures, as well as on quality requirements and evaluation. SQuaRE replaces the current ISO/IEC 9126 series and the ISO/IEC 14598 series. The SQuaRE series of st
35、andards consists of the following divisions under the general title Systems and software Quality Requirements and Evaluation: ISO/IEC 2500n - Quality Management Division, ISO/IEC 2501n - Quality Model Division, ISO/IEC 2502n - Quality Measurement Division, ISO/IEC 25041:2012(E) ISO/IEC 2012 All righ
36、ts reserved vii ISO/IEC 2503n - Quality Requirements Division, and ISO/IEC 2504n - Quality Evaluation Division. This International Standard is intended to be used in conjunction with the other parts of the SQuaRE series of standards, and with the ISO/IEC 14598 series and ISO/IEC 9126 series until su
37、perseded by the ISO/IEC 250nn series of standards. The descriptions in this International Standard are mainly based on the descriptions in ISO/IEC 14598-3, ISO/IEC 14598-4, and ISO/IEC 14598-5, which will be replaced by this International Standard. Figure 1 illustrates the organization of the SQuaRE
38、 series representing families of standards, further called Divisions. Figure 1 Organization of SQuaRE series of International Standards The Divisions within the SQuaRE model are: ISO/IEC 2500n - Quality Management Division. The International Standards that form this division define all common models
39、, terms and definitions referred to by all other standards from the SQuaRE series. Referring paths (guidance through SQuaRE documents) and high level practical suggestions in applying proper standards to specific application cases offer help to all types of users. The division also provides requirem
40、ents and guidance for a supporting function which is responsible for the management of product requirements specification and evaluation. ISO/IEC 2501n - Quality Model Division. The International Standard that forms this division presents detailed quality models for software, quality in use and data
41、. Practical guidance on the use of the quality model is also provided. ISO/IEC 2502n - Quality Measurement Division. The International Standards that form this division include a product quality measurement reference model, mathematical definitions of quality measures, and practical ISO/IEC 25041:20
42、12(E) viii ISO/IEC 2012 All rights reservedguidance for their application. This division presents internal measures of software quality, external measures of software product quality and quality in use measures. Measurement primitives forming foundations for the latter measures are defined and prese
43、nted. ISO/IEC 2503n - Quality Requirements Division. The International Standard that forms this division helps specifying quality requirements. These quality requirements can be used in the process of quality requirements elicitation for a product to be developed or as inputs for an evaluation proce
44、ss. The requirements definition process is mapped to technical processes defined in ISO/IEC 15288:2008. ISO/IEC 2504n - Quality Evaluation Division. The International Standards that form this division provide requirements, recommendations and guidelines for product evaluation, whether performed by i
45、ndependent evaluators, acquirers or developers. The support for documenting a measure as an Evaluation Module is also presented. ISO/IEC 25050 to ISO/IEC 25099 are reserved to be used for SQuaRE extension International Standards and/or Technical Reports. This International Standard is part of the 25
46、04n - Quality Evaluation Division that currently consists of the following International Standards: ISO/IEC 25040 - Evaluation process: contains general requirements for specification and evaluation of software quality and clarifies the general concepts. It provides a process description for evaluat
47、ing quality of product and states the requirements for the application of this process. The evaluation process is the basis for product quality evaluation for different purposes and approaches. Therefore the process can be used for the evaluation of quality in use, the external measure of software p
48、roduct quality and the internal measure of software product quality, as well as for the evaluation of the quality of pre-developed software product or custom software product during its development process. ISO/IEC 25041 - Evaluation guide for developers, acquirers and independent evaluators: contai
49、ns specific requirements and recommendations for developers, acquirers and independent evaluators. ISO/IEC 25045 - Evaluation module for recoverability: provides the specification to evaluate the subcharacteristics of recoverability defined under the characteristic of reliability of the quality model. It determines the external measures of software product quality of resiliency and autonomic recovery index when the information system composed of one or more software products execution transactions is subjected t
