1、BRITISH STANDARD BS ISO/IEC 14598-6:2001 Software engineering Product evaluation Part 6: Documentation of evaluation modules ICS 35.080 NO COPYING WITHOUT BSI PERMISSION EXCEPT AS PERMITTED BY COPYRIGHT LAWBS ISO/IEC 14598-6:2001 This British Standard, having been prepared under the direction of the
2、 DISC Board, was published under the authority of the Standards Policy and Strategy Committee on 20 September 2001 BSI 20 September 2001 ISBN 0 580 38488 8 National foreword This British Standard reproduces verbatim ISO/IEC 14598-6:2001 and implements it as the UK national standard. The UK participa
3、tion in its preparation was entrusted to Technical Committee IST/15, Software Engineering, which has the responsibility to: A list of organizations represented on this committee can be obtained on request to its secretary. Cross-references The British Standards which implement international or Europ
4、ean publications referred to in this document may be found in the BSI Standards Catalogue under the section entitled “International Standards Correspondence Index”, or by using the “Find” facility of the BSI Standards Electronic Catalogue. A British Standard does not purport to include all the neces
5、sary provisions of a contract. Users of British Standards are responsible for their correct application. Compliance with a British Standard does not of itself confer immunity from legal obligations. aid enquirers to understand the text; present to the responsible international/European committee any
6、 enquiries on the interpretation, or proposals for change, and keep the UK interests informed; monitor related international and European developments and promulgate them in the UK. Summary of pages This document comprises a front cover, an inside front cover, the ISO/IEC title page, pages ii to v,
7、a blank page, pages 1 to 31 and a back cover. The BSI copyright date displayed in this document indicates when the document was last issued. Amendments issued since publication Amd. No. Date CommentsReference number ISO/IEC 14598-6:2001(E) INTERNATIONAL STANDARD ISO/IEC 14598-6 First edition 2001-06
8、-01 Software engineering Product evaluation Part 6: Documentation of evaluation modules Ingnierie du logiciel valuation du produit Partie 6: Documentation des modules dvaluationISO/IEC 14598-6:2001(E) ii ISO/IEC 14598-6:2001(E)iii Contents Page 1 Scope 1 2 Conformance1 3 Normative references 1 4 Ter
9、ms and definitions .2 5 The evaluation module concept.2 6 Format for documentation of an evaluation module3 6.1 EM0 : Foreword and introduction 3 6.1.1 Foreword.3 6.1.2 Introduction3 6.2 EM1 : Scope3 6.2.1 Characteristics.3 6.2.2 Level of evaluation 3 6.2.3 Techniques.4 6.2.4 Applicability4 6.3 EM2
10、: References.4 6.4 EM3 : Terms and definitions.4 6.5 EM4 : Inputs and metrics 4 6.5.1 Input for the evaluation .4 6.5.2 Data elements.5 6.5.3 Metrics and measures .5 6.6 EM5 : Interpretation of results5 6.6.1 Mapping of measures5 6.6.2 Reporting5 6.7 EMA : Application procedure .5 6.7.1 Definition o
11、f Technical Terms Used.5 6.7.2 Resources Required5 6.7.3 Evaluation instructions .6 6.7.4 Documentation.6 Annex A (informative) Development of evaluation modules 7 Annex B (informative) Example of an evaluation module Fault density.8 Annex C (informative) Example of an evaluation module Functionalit
12、y 12 Annex D (informative) Example of an evaluation module Usability and Quality in Use .25 Bibliography31ISO/IEC 14598-6:2001(E) iv Foreword ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide sta
13、ndardization. National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields
14、of mutual interest. Other international organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the work. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 3. In the field of information technology, ISO and
15、 IEC have established a joint technical committee, ISO/IEC JTC 1. Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as an International Standard requires approval by at least 75 % of the national bodies casting a vote. At
16、tention is drawn to the possibility that some of the elements of this part of ISO/IEC 14598 may be the subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. International Standard ISO/IEC 14598-6 was prepared by Joint Technical Committee I
17、SO/IEC JTC 1, Information technology, Subcommittee SC 7, Software engineering. ISO/IEC 14598-6 is intended for use in conjunction with ISO/IEC 9126-1 (in preparation) which will replace ISO/IEC 9126:1991. ISO/IEC 14598 consists of the following parts, under the general title Software engineering Pro
18、duct evaluation: Part 1: General overview Part 2: Planning and management Part 3: Process for developers Part 4: Process for acquirers Part 5: Process for evaluators Part 6: Documentation of evaluation modules Annexes A, B, C and D of this part of ISO/IEC 14598 are for information only.ISO/IEC 14598
19、-6:2001(E)v Introduction Software product evaluation depends on a set of evaluation techniques and metrics that provide information about the quality characteristics of the software. Many metrics and associated methods for using the measurement results can be used for specific software product evalu
20、ation. ISO/IEC 9126-2 and ISO/IEC 9126-3 provide example metrics that correspond to one sub-characteristic. It is difficult to use these metrics consistently in an organisation. It may be necessary to develop new metrics for specific use. Therefore, it is necessary that a supporting function (see 14
21、598-2) in the organisation specifies each metric for correct and consistent use within the organisation. The format for documenting a metric and associated methods, as well as guides for their use, should be standardised. The concept of an evaluation module provides a solution to this need. An evalu
22、ation module specifies the evaluation methods applicable for evaluating a quality characteristic and identifies the evidence it needs. It also defines the elementary evaluation procedure and the format for reporting the measurements resulting from the application of the techniques. A consistent way
23、of documenting evaluation modules has a number of advantages: It provides a common reference in the description of the theoretical basis of evaluation modules. It identifies a minimal set of requirements for documenting and developing evaluation modules. It provides a necessary tool in collecting an
24、d cataloguing the large number of evaluation modules anticipated. Evaluation modules provide a flexible and structured approach to making metrics applicable for evaluating intermediate and completed products. The use of evaluation modules produced according to this part of ISO/IEC 14598 helps to ens
25、ure that software product evaluations can be repeatable, reproducible and objective. The format for documenting an evaluation module takes into account the following: It will be applied within the context of the evaluation of software products. The format supports the need for developing new metrics
26、 with respect to state of the art. The format provides a precise definition of metrics and their application. It provides the information needed for those who will use them for an evaluation. Annex A provides guidance for the development process for new evaluation modules. Annexes B, C and D are examples of evaluation modules.
