1、BSI Standards Publication Information technology Process assessment Requirements for process measurement frameworks BS ISO/IEC 33003:2015National foreword This British Standard is the UK implementation of ISO/IEC 33003:2015. Together with BS ISO/IEC 33002, BS ISO/IEC 33004 and BS ISO/IEC 33020 it su
2、persedes BS ISO/IEC 15504-2:2003. Together with BS ISO/IEC 33001:2015, BS ISO/IEC 33002, BS ISO/IEC 33004, BS ISO/IEC 33010, and BS ISO/IEC 33014 it also supersedes PD ISO/IEC 15504-7:2008. These two standards will be withdrawn upon publication of the full series. The UK participation in its prepara
3、tion was entrusted to Technical Committee IST/15, Software and systems engineering. A list of organizations represented on this committee can be obtained on request to its secretary. This publication does not purport to include all the necessary provisions of a contract. Users are responsible for it
4、s correct application. The British Standards Institution 2015. Published by BSI Standards Limited 2015 ISBN 978 0 580 74308 5 ICS 35.080 Compliance with a British Standard cannot confer immunity from legal obligations. This British Standard was published under the authority of the Standards Policy a
5、nd Strategy Committee on 30 April 2015. Amendments/corrigenda issued since publication Date Text affected BRITISH STANDARD BS ISO/IEC 33003:2015Information technology Process assessment Requirements for process measurement frameworks Technologies de linformation valuation du processus Exigences rela
6、tives au cadres de mesure du processus INTERNATIONAL STANDARD ISO/IEC 33003 Reference number ISO/IEC 33003:2015(E) Second edition 2015-03-01 ISO/IEC 2015 BS ISO/IEC 33003:2015 ii ISO/IEC 2015 All rights reserved COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2015 All rights reserved. Unless otherwise specifie
7、d, no part of this publication may be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below or ISOs
8、member body in the country of the requester. ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.org Published in Switzerland ISO/IEC 33003:2015(E) BS ISO/IEC 33003:2015 ISO/IEC 33003:2015(E)Foreword iv Introduction
9、v 1 Scope . 1 2 Normative references 1 3 T erms and definitions . 1 4 Requirements for process measurement frameworks . 4 4.1 Conceptualization . 4 4.1.1 Requirements . 4 4.1.2 Guidance 4 4.2 Construct definition 4 4.2.1 Requirements . 4 4.2.2 Guidance 5 4.3 Operationalization . 5 4.3.1 Requirements
10、 . 5 4.3.2 Guidance 5 4.4 Construct specification examination . 5 4.4.1 Requirements . 5 4.4.2 Guidance 5 4.5 Rating process attributes . 6 4.5.1 Requirements . 6 4.5.2 Guidance 6 4.6 Aggregation 7 4.6.1 Requirements . 7 4.6.2 Guidance 7 4.7 Sensitivity analysis 8 4.7.1 Requirements . 8 4.7.2 Guidan
11、ce 8 5 Requirements for the validation of process measurement frameworks .8 5.1 Requirements . 8 5.2 Guidance . 8 5.2.1 Reliability . 9 5.2.2 Construct validity 9 5.2.3 Construct specification . 9 6 Verifying conformity of process measurement frameworks 9 Annex A (informative) A terminology map.11 A
12、nnex B (informative) C onstruct specification: R eflecti v e or formati v e .13 Annex C (informative) Some statistical validation methods .15 Annex D (informative) Methods for implementing the requirements for process measurement frameworks 18 Bibliography .20 ISO/IEC 2015 All rights reserved iii Co
13、ntents Page BS ISO/IEC 33003:2015 ISO/IEC 33003:2015(E) Foreword ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC participate in t
14、he development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmental and non-g
15、overnmental, in liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. The procedures used to develop this document and those intended for its further maintenance are described in the ISO/
16、IEC Directives, Part 1. In particular the different approval criteria needed for the different types of document should be noted. This document was drafted in accordance with the editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives). Attention is drawn to the possibility tha
17、t some of the elements of this document may be the subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. Details of any patent rights identified during the development of the document will be in the Introduction and/or on the ISO list of p
18、atent declarations received (see www.iso.org/patents). Any trade name used in this document is information given for the convenience of users and does not constitute an endorsement. For an explanation on the meaning of ISO specific terms and expressions related to conformity assessment, as well as i
19、nformation about ISOs adherence to the WTO principles in the Technical Barriers to Trade (TBT) see the following URL: Foreword - Supplementary information The committee responsible for this document is ISO/IEC JTC 1, Information technology, SC 7, Software and systems engineering.iv ISO/IEC 2015 All
20、rights reserved BS ISO/IEC 33003:2015 ISO/IEC 33003:2015(E) Introduction This International Standard provides requirements for process measurement frameworks that support and enable the assessment of process quality characteristics, from conceptualization to empirical validation. In process measurem
21、ent frameworks, measurement of a process quality characteristic produces a composite measure (e.g. process capability levels of ordinal scale in ISO/IEC 33020). Examples of process quality characteristics that are constructs (theoretical concepts) include process capability, process security, proces
22、s agility, and process safety. The main users of this International Standard are developers of process measurement frameworks and process assessment models. Conformity to this International Standard ensures that any process measurement framework is developed with reliable structures or elements whic
23、h will generate quality composite measures. This International Standard is part of a set of International Standards designed to provide a consistent and coherent framework for the assessment of process quality characteristics, based on objective evidence resulting from implementation of the processe
24、s. The framework for assessment covers processes employed in the development, maintenance, and use of systems across the information technology domain and those employed in the design, transition, delivery, and improvement of services. The set of International Standards, as a whole, addresses proces
25、s quality characteristics of any type. Results of assessment can be applied for improving process performance, or for identifying and addressing risks associated with application of processes. This International Standard provides requirements for the development of process measurement frameworks, su
26、ch as ISO/IEC 33020. These can then be used to define process assessment models, conformant to ISO/IEC 33004, that can be employed for process assessments conformant with ISO/IEC 33002. The overall architecture and content of the series is described in ISO/IEC 33001. Several International Standards
27、in the ISO/IEC 330x x f amily of st andards for process assessment are intended to replace and extend parts of the ISO/IEC 15504 series of Standards. ISO/IEC 33001, Annex A provides a detailed record of the relationship between the ISO/IEC 330xx family and the ISO/IEC 15504 series. ISO/IEC 2015 All
28、rights reserved v BS ISO/IEC 33003:2015 Information technology Process assessment Requirements for process measurement frameworks 1 Scope This International Standard sets out the requirements for process measurement frameworks for use in process assessment. The requirements defined in this Internati
29、onal Standard form a structure which a) establish the requirements for process measurement frameworks in the context of process assessment, b) establish the requirements for the validation of process measurement frameworks for use in process assessment, and c) establish requirements that are applica
30、ble to any process measurement frameworks to develop composite measures across domains. This International Standard is applicable to the development of process measurement frameworks for any process quality characteristic across all application domains. Annex A presents a map of terminologies used i
31、n this International Standard. Annex B provides an explanation of construct specifications. Annex C reviews statistical validation methods. Annex D provides some methods including references that can be utilized in implementing the requirements for process measurement frameworks. These Annexes will
32、be moved to a guide for constructing process measurement frameworks to be developed as part of the set of International Standards. NOTE ISO/IEC 33020 is a process measurement framework for assessment of process capability based on this International Standard. 2 Normative references The following doc
33、uments, in whole or in part, are normatively referenced in this document and are indispensable for its application. For dated references, only the edition cited applies. For undated references, the latest edition of the referenced document (including any amendments) applies ISO/IEC 15939:2007, Syste
34、ms and software engineering Measurement process ISO/IEC 33001:2015, Information technology Process assessment Concepts and terminology 3 T erms a nd definiti ons For the purposes of this document, the terms and definitions given in ISO/IEC 33001, ISO/IEC 15939, and the following apply: 3.1 aggregati
35、on method method that combines a set of measurement values to create a composite value Note 1 to entry: Aggregation methods are based on compensatory or non-compensatory models. INTERNATIONAL ST ANDARD ISO/IEC 33003:2015(E) ISO/IEC 2015 All rights reserved 1 BS ISO/IEC 33003:2015 ISO/IEC 33003:2015(
36、E) 3.2 compensatory model MCDM model in which a composite measure is composed of individually weighted terms and where criteria (also refer to attribute terms) with a high value can compensate for those of a low value in proportion to each weight Note 1 to entry: A compensatory model suggests that i
37、mproving the more important measures (those with a higher weighting) is more likely to increase or improve the overall composite value than improving the less important ones. This model assumes that the weight (influence level) of criteria remains the same regardless of the measured level of the cri
38、teria. 3.3 composite measure variable derived from a set of operations of a constructs multi-item measures defined according to construct specification (either reflective or formative) that is the way in which the latent variable representing the construct of interest is linked to its measures 3.4 c
39、omposite value value from a composite measure Note 1 to entry: A composite value can be from an ordinal, interval, or ratio scale. 3.5 construct concept such as the abstract idea, image, underlying theme, or subject matter that one wishes to measure using process assessments Note 1 to entry: In proc
40、ess measurement frameworks, constructs (also refers to latent constructs) are theoretical concepts such as the process quality characteristics and process attributes. Note 2 to entry: The meaning that one assigns to a construct is called theoretical definition, which should explain its meaning, as w
41、ell as discuss its distinct dimensions (facets). 3.6 dimension distinct components that a multidimensional construct encompasses 3.7 formative construct construct that is formed from its observed measures in the relationship between a construct and its measures Note 1 to entry: The construct is a co
42、nsequence of its measures and each measure is a determinant of the construct. 3.8 latent variable variable representing a unidimensional construct Note 1 to entry: There should be a separate latent variable for each dimension of a construct and a minimum of one measure per latent variable. 3.9 MCDM
43、Multiple-Criteria Decision Making or Multi-Attribute Decision Making making preference decisions (e.g., evaluation, prioritization, and selection) of available alternatives characterized by multiple criteria Note 1 to entry: A criterion in MCDM corresponds to measure. Note 2 to entry: An MCDM with o
44、ne alternative is the same as the development of a composite measure.2 ISO/IEC 2015 All rights reserved BS ISO/IEC 33003:2015 ISO/IEC 33003:2015(E) 3.10 measurement model the implicit or explicit relationship between a latent variable and its (multi-item) measures Note 1 to entry: The relationship b
45、etween a reflective (formative) construct and its measure(s) is called a reflective (formative) measurement model. 3.11 multidimensional construct construct that consists of a number of unidimensional constructs. Note 1 to entry: Each dimension of a multidimensional construct is called unidimensiona
46、l and is represented by one latent variable. Each dimension can have multiple measures. In a multidimensional construct, for example, the meaning of capability when it is defined as the common factor underlying its process attributes is different from the case when capability is defined as a simple
47、sum of its process attributes. The former is called a reflective multidimensional construct and the latter is formative. A multidimensional construct can span an indeterminate number of levels. 3.12 non-compensatory model MCDM model that does not allow criteria to compensate for each other in propor
48、tion to their weights Note 1 to entry: Strongly positive or negative terms influence the overall composite value disproportionately, although the weight stays the same. There are various non-compensatory models depending on the evaluation policy, the purpose of the composite measure, and/or the meas
49、urement scale. 3.13 r e f le c t i ve c on s t r u c t construct that is viewed as the cause of measures in the relationship between a construct and its measures Note 1 to entry: Reflective construct is an underlying factor of the variation of its measures. 3.14 scale ordered set of values, continuous, or discrete, or a set of categories to which the attribute is mapped Note 1 to entry: The type of scale depends on the nature of the relationship between values on the scale. Four types of scales are commonly defined: Nominal the
