1、 Reference numberISO/IEC TR 9126-4:2004(E)ISO/IEC 2004Software engineering Product quality Part 4: Quality in use metrics Gnie du logiciel Qualit des produits Partie 4: Qualit en mtrologie dusage National Standard of CanadaCAN/CSA-ISO/IEC TR 9126-4:05(ISO/IEC TR 9126-4:2004)Technical Report ISO/IEC
2、TR 9126-4:2004 (first edition, 2004-04-01) has been adopted withoutmodification (IDT) as CSA Standard CAN/CSA-ISO/IEC TR 9126-4:05, which has been approved as aNational Standard of Canada by the Standards Council of Canada.ISBN 1-55397-941-9 October 2005The Canadian Standards Association (CSA), unde
3、r whose auspices this National Standard has been produced, was chartered in 1919 and accredited by the Standards Council of Canada to the National Standards system in 1973. It is a not-for-profit, nonstatutory, voluntary membership association engaged in standards development and certification activ
4、ities. CSA standards reflect a national consensus of producers and users including manufacturers, consumers, retailers, unions and professional organizations, and governmental agencies. The standards are used widely by industry and commerce and often adopted by municipal, provincial, and federal gov
5、ernments in their regulations, particularly in the fields of health, safety, building and construction, and the environment. Individuals, companies, and associations across Canada indicate their support for CSAs standards development by volunteering their time and skills to CSA Committee work and su
6、pporting the Associations objectives through sustaining memberships. The more than 7000 committee volunteers and the 2000 sustaining memberships together form CSAs total membership from which its Directors are chosen. Sustaining memberships represent a major source of income for CSAs standards devel
7、opment activities. The Association offers certification and testing services in support of and as an extension to its standards development activities. To ensure the integrity of its certification process, the Association regularly and continually audits and inspects products that bear the CSA Mark.
8、 In addition to its head office and laboratory complex in Toronto, CSA has regional branch offices in major centres across Canada and inspection and testing agencies in eight countries. Since 1919, the Association has developed the necessary expertise to meet its corporate mission: CSA is an indepen
9、dent service organization whose mission is to provide an open and effective forum for activities facilitating the exchange of goods and services through the use of standards, certification and related services to meet national and international needs.For further information on CSA services, write to
10、Canadian Standards Association5060 Spectrum Way, Suite 100Mississauga, Ontario, L4W 5N6CanadaThe Standards Council of Canada is the coordinating body of the National Standards system, a federation of independent, autonomous organizations working towards the further development and improvement of vol
11、untary standardization in the national interest. The principal objects of the Council are to foster and promote voluntary standardization as a means of advancing the national economy, benefiting the health, safety, and welfare of the public, assisting and protecting the consumer, facilitating domest
12、ic and international trade, and furthering international cooperation in the field of standards. A National Standard of Canada is a standard which has been approved by the Standards Council of Canada and one which reflects a reasonable agreement among the views of a number of capable individuals whos
13、e collective interests provide to the greatest practicable extent a balance of representation of producers, users, consumers, and others with relevant interests, as may be appropriate to the subject in hand. It normally is a standard which is capable of making a significant and timely contribution t
14、o the national interest. Approval of a standard as a National Standard of Canada indicates that a standard conforms to the criteria and procedures established by the Standards Council of Canada. Approval does not refer to the technical content of the standard; this remains the continuing responsibil
15、ity of the accredited standards development organization. Those who have a need to apply standards are encouraged to use National Standards of Canada whenever practicable. These standards are subject to periodic review; therefore, users are cautioned to obtain the latest edition from the organizatio
16、n preparing the standard.The responsibility for approving National Standards of Canada rests with theStandards Council of Canada270 Albert Street, Suite 200Ottawa, Ontario, K1P 6N7CanadaAlthough the intended primary application of this Standard is stated in its Scope, it is importantto note that it
17、remains the responsibility of the users to judge its suitability for their particular purpose.Registered trade-mark of Canadian Standards AssociationCette norme est offerte en anglais seulement pour le moment. La CSA publiera la version enfranais ds quelle sera produite par lorganisme rdacteur.CAN/C
18、SA-ISO/IEC TR 9126-4:05Software engineering Product quality Part 4: Quality in use metricsOctober 2005 Canadian Standards Association CSA/1CAN/CSA-ISO/IEC TR 9126-4:05Software engineering Product quality Part 4: Quality in use metricsCSA PrefaceStandards development within the Information Technology
19、 sector is harmonized with international standards development. Through the CSA Technical Committee on Information Technology (TCIT), Canadians serve as the Canadian Advisory Committee (CAC) on ISO/IEC Joint Technical Committee 1 on Information Technology (ISO/IEC JTC1) for the Standards Council of
20、Canada (SCC), the ISO member body for Canada and sponsor of the Canadian National Committee of the IEC. Also, as a member of the International Telecommunication Union (ITU), Canada participates in the International Telegraph and Telephone Consultative Committee (ITU-T).At the time of publication, IS
21、O/IEC TR 9126-4:2004 is available from ISO and IEC in English only. CSA will publish the French version when it becomes available from ISO and IEC.This Technical Report was reviewed by the CSA TCIT under the jurisdiction of the Strategic Steering Committee on Information Technology and deemed accept
22、able for use in Canada. (A committee membership list is available on request from the CSA Project Manager.) From time to time, ISO/IEC may publish addenda, corrigenda, etc. The CSA TCIT will review these documents for approval and publication. For a listing, refer to the CSA Information Products cat
23、alogue or CSA Info Update or contact a CSA Sales representative. This Standard has been formally approved, without modification, by the Technical Committee and has been approved as a National Standard of Canada by the Standards Council of Canada.October 2005 Canadian Standards Association 2005All ri
24、ghts reserved. No part of this publication may be reproduced in any form whatsoever without the prior permission ofthe publisher. ISO/IEC material is reprinted with permission. Where the words “this Technical Report” appear in the text, they should be interpreted as “this National Standard of Canada
25、”.Inquiries regarding this National Standard of Canada should be addressed toCanadian Standards Association5060 Spectrum Way, Suite 100, Mississauga, Ontario, Canada L4W 5N61-800-463-6727 416-747-4044www.csa.caReference numberISO/IEC TR 9126-4:2004(E)ISO/IEC 2004TECHNICAL REPORT ISO/IECTR9126-4First
26、 edition2004-04-01Software engineering Product quality Part 4: Quality in use metrics Gnie du logiciel Qualit des produits Partie 4: Qualit en mtrologie dusage ISO/IEC TR 9126-4:2004(E) PDF disclaimer This PDF file may contain embedded typefaces. In accordance with Adobes licensing policy, this file
27、 may be printed or viewed but shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading this file, parties accept therein the responsibility of not infringing Adobes licensing policy. The ISO Central Secretariat a
28、ccepts no liability in this area. Adobe is a trademark of Adobe Systems Incorporated. Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation parameters were optimized for printing. Every care has been taken to ensure that
29、 the file is suitable for use by ISO member bodies. In the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below. ISO/IEC 2004 All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized
30、in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41
31、22 749 09 47 E-mail copyrightiso.org Web www.iso.org ii ISO/IEC 2004 All rights reservedISO/IEC TR 9126-4:2004(E) ISO/IEC 2004 All rights reserved iiiContents 1 Scope 1 2 Conformance 2 3 Normative References. 2 4 Terms and definitions 2 4.1 Context of use 2 4.2 Goal 2 4.3 Task . 3 5 Symbols and abbr
32、eviated terms 3 6 Use of software quality metrics 3 7 How to read and use the metrics tables 4 8 Metrics Tables 4 8.1 Effectiveness metrics. 6 8.2 Productivity metrics 7 8.3 Safety metrics 9 8.4 Satisfaction metrics 11 Annex A (Informative) Considerations when using metrics . 12 A.1 Interpretation o
33、f measures. 12 A.2 Validation of metrics. 13 A.3 Use of metrics for estimation (judgement) and prediction (forecast). 15 A.4 Detecting deviations and anomalies in quality problem prone components 16 A.5 Displaying measurement results 16 Annex B (Informative) Use of Quality in Use, External type 2, w
34、hen the subject is still under technical development or where for any other reason there is the future but not immediate possibility of an agreement on an International Standard; type 3, when the joint technical committee has collected data of a different kind from that which is normally published a
35、s an International Standard (“state of the art”, for example). Technical Reports of types 1 and 2 are subject to review within three years of publication, to decide whether they can be transformed into International Standards. Technical Reports of type 3 do not necessarily have to be reviewed until
36、the data they provide are considered to be no longer valid or useful. Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. ISO/IEC TR 9126-4 which
37、 is a Technical Report of type 2, was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology, Subcommittee SC 7, Software and system engineering. ISO/IEC TR 9126 consists of the following parts, under the general title Software engineering Product quality : Part 1: Quality model
38、 Part 2: External metrics Part 3: Internal metrics Part 4: Quality in use metrics ISO/IEC TR 9126-4:2004(E) ISO/IEC 2004 All rights reserved vIntroduction This Technical Report provides quality in use metrics for measuring attributes of quality in use defined in ISO/IEC 9126-1. The metrics listed in
39、 this Technical Report are not intended to be an exhaustive set. Developers, evaluators, quality managers and acquirers may select metrics from this Technical Report for defining requirements, evaluating software products, measuring quality aspects and other purposes. They may also modify the metric
40、s or use metrics that are not included here. This report is applicable to any kind of software product, although each of the metrics is not always applicable to every kind of software product. ISO/IEC 9126-1 defines terms for the software quality characteristics and how these characteristics are dec
41、omposed into subcharacteristics. ISO/IEC 9126-1, however, does not describe how any of these subcharacteristics could be measured. ISO/IEC 9126-2 defines external metrics, ISO/IEC 9126-3 defines internal metrics and ISO/IEC 9126-4 defines quality in use metrics, for measurement of the characteristic
42、s or subcharacteristics. Internal metrics measure the software itself, external metrics measure the behaviour of the computer-based system that includes the software, and quality in use metrics measure the effects of using the software in a specific context of use. This Technical Report is intended
43、to be used together with ISO/IEC 9126-1. It is strongly recommended to read ISO/IEC 14598-1 and ISO/IEC 9126-1, prior to using this Technical Report, particularly if the reader is not familiar with the use of software metrics for product specification and evaluation. TECHNICAL REPORT ISO/IEC TR 9126
44、-4:2004(E) ISO/IEC 2004 All rights reserved 1Software engineering Product quality Part 4: Quality in use metrics 1 Scope This Technical Report defines quality in use metrics for the characteristics defined in ISO/IEC 9126-1, and is intended to be used together with ISO/IEC 9126-1. This Technical Rep
45、ort contains: an explanation of how to apply software quality metrics; a basic set of metrics for each characteristic; an example of how to apply metrics during the software product life cycle. It includes as informative annexes a quality in use evaluation process and a reporting format. This Techni
46、cal Report does not assign ranges of values of these metrics to rated levels or to grades of compliance, because these values are defined for each software product or a part of the software product, by its nature, depending on such factors as category of the software, integrity level and users needs
47、. Some attributes may have a desirable range of values, which does not depend on specific user needs but depends on generic factors, i.e. human cognitive factors. This Technical Report can be applied to any kind of software for any application. Users of this Technical Report can select or modify and
48、 apply metrics and measures from this Technical Report or may define application-specific metrics for their individual application domain. For example, the specific measurement of quality characteristics such as safety or security may be found in International Standards or Technical Reports provided
49、 by IEC 65 and ISO/IEC JTC1/SC 27. Intended users of this Technical Report include: Acquirer (an individual or organization that acquires or procures a system, software product or software service from a supplier); Evaluator (an individual or organization that performs an evaluation. An evaluator may, for example, be a testing laboratory, the quality department of a software development organization, a government organization or user); Developer (an individual or organization that perfor
