1、 National Standard of CanadaCAN/CSA-ISO/IEC 14598-1:02(ISO/IEC 14598-1:1999)International Standard ISO/IEC 14598-1:1999 (first edition, 1999-04-15), has been adopted withoutmodification (IDT) as CSA Standard CAN/CSA-ISO/IEC 14598-1:02, which has been approved as a NationalStandard of Canada by the S
2、tandards Council of Canada.ISBN 1-55324-681-0 March 2002Technologies de linformation valuation de produits logiciels Partie 1: Aperu gnralReference numberISO/IEC 14598-1:1999(E)The Canadian Standards Association (CSA), The Standards Council of Canada is theunder whose auspices this National Standard
3、 has been coordinating body of the National Standards system, produced, was chartered in 1919 and accredited by a federation of independent, autonomousthe Standards Council of Canada to the National organizations working towards the furtherStandards system in 1973. It is a not-for-profit, developmen
4、t and improvement of voluntarynonstatutory, voluntary membership association standardization in the national interest.engaged in standards development and certification The principal objects of the Council are to foster activities. and promote voluntary standardization as a means CSA standards refle
5、ct a national consensus of of advancing the national economy, benefiting theproducers and users including manufacturers, health, safety, and welfare of the public, assisting consumers, retailers, unions and professional and protecting the consumer, facilitating domestic organizations, and government
6、al agencies. The and international trade, and furthering internationalstandards are used widely by industry and commerce cooperation in the field of standards.and often adopted by municipal, provincial, and A National Standard of Canada is a standard whichfederal governments in their regulations, pa
7、rticularly in has been approved by the Standards Council ofthe fields of health, safety, building and construction, Canada and one which reflects a reasonableand the environment. agreement among the views of a number of capableIndividuals, companies, and associations across individuals whose collect
8、ive interests provide to theCanada indicate their support for CSAs standards greatest practicable extent a balance ofdevelopment by volunteering their time and skills to representation of producers, users, consumers, andCSA Committee work and supporting the Associations others with relevant interest
9、s, as may be appropriateobjectives through sustaining memberships. The more to the subject in hand. It normally is a standardthan 7000 committee volunteers and the 2000 which is capable of making a significant and timelysustaining memberships together form CSAs total contribution to the national int
10、erest.membership from which its Directors are chosen. Approval of a standard as a National Standard ofSustaining memberships represent a major source of Canada indicates that a standard conforms to theincome for CSAs standards development activities. criteria and procedures established by the Standa
11、rdsThe Association offers certification and testing Council of Canada. Approval does not refer to theservices in support of and as an extension to its technical content of the standard; this remains thestandards development activities. To ensure the continuing responsibility of the accreditedintegri
12、ty of its certification process, the Association standards-development organization.regularly and continually audits and inspects products Those who have a need to apply standards arethat bear the CSA Mark. encouraged to use National Standards of CanadaIn addition to its head office and laboratory c
13、omplex whenever practicable. These standards are subject in Toronto, CSA has regional branch offices in major to periodic review; therefore, users are cautioned centres across Canada and inspection and testing to obtain the latest edition from the organizationagencies in eight countries. Since 1919,
14、 the preparing the standard.Association has developed the necessary expertise to The responsibility for approving National Standards meet its corporate mission: CSA is an independent of Canada rests with theservice organization whose mission is to provide an Standards Council of Canadaopen and effec
15、tive forum for activities facilitating the 270 Albert Street, Suite 200exchange of goods and services through the use of Ottawa, Ontario, K1P 6N7standards, certification and related services to meet Canadanational and international needs.For further information on CSA services, write toCanadian Stan
16、dards Association178 Rexdale BoulevardToronto, Ontario, M9W 1R3CanadaAlthough the intended primary application of this Standard is stated in its Scope, it is importantto note that it remains the responsibility of the users to judge its suitability for their particular purpose.Registered trade-mark o
17、f Canadian Standards AssociationCAN/CSA-ISO/IEC 14598-1:02 evaluation Part 1: General overviewInformation technology Software productMarch 2002 Canadian Standards Association CSA/1CAN/CSA-ISO/IEC 14598-1:02Information technology Softwareproduct evaluation Part 1:General overviewCSA PrefaceStandards
18、development within the Information Technology sector is harmonized with internationalstandards development. Through the CSA Technical Committee on Information Technology (TCIT),Canadians serve as the Canadian Advisory Committee (CAC) on ISO/IEC Joint Technical Committee 1 onInformation Technology (I
19、SO/IEC JTC1) for the Standards Council of Canada (SCC), the ISO memberbody for Canada and sponsor of the Canadian National Committee of the IEC. Also, as a member of theInternational Telecommunication Union (ITU), Canada participates in the International Telegraph andTelephone Consultative Committee
20、 (ITU-T).This International Standard was reviewed by the CSA TCIT under the jurisdiction of the StrategicSteering Committee on Information Technology and deemed acceptable for use in Canada. (Acommittee membership list is available on request from the CSA Project Manager.) From time to time,ISO/IEC
21、may publish addenda, corrigenda, etc. The CSA TCIT will review these documents for approvaland publication. For a listing, refer to the CSA Information Products catalogue or CSA Info Update orcontact a CSA Sales representative. This Standard has been formally approved, without modification, bythese
22、Committees and has been approved as a National Standard of Canada by the Standards Council ofCanada.March 2002 Canadian Standards Association 2002All rights reserved. No part of this publication may be reproduced in any form whatsoever without the prior permission ofthe publisher. ISO/IEC material i
23、s reprinted with permission. Where the words “this International Standard” appear in thetext, they should be interpreted as “this National Standard of Canada”. Inquiries regarding this National Standard of Canada should be addressed to Canadian Standards Association 178 Rexdale Boulevard, Toronto, O
24、ntario, Canada M9W 1R31-800-463-6727 416-747-4044www.csa.caB CReference numberISO/IEC 14598-1:1999(E)INTERNATIONALSTANDARDISO/IEC14598-1First edition1999-04-15Information technology Software productevaluation Part 1:General overviewTechnologies de linformation valuation de produits logiciels Partie
25、1: Aperu gnralISO/IEC 14598-1:1999(E) ISO/IEC 1999All rights reserved. Unless otherwise specified, no part of this publication may be reproduced orutilized in any form or by any means, electronic or mechanical, including photocopying and micro-film, without permission in writing from the publisher.I
26、SO/IEC Copyright Office Case postale 56 CH-1211 Genve 20 SwitzerlandiiContents1 Scope.12 Conformance 13 Normative references.14 Terms and definitions25 Overview of ISO/IEC 14598 and ISO/IEC 9126 .65.1 Structure of ISO/IEC 14598 and ISO/IEC 9126 .65.2 Evaluation process .65.3 Support for evaluation 6
27、5.4 Software quality characteristics and metrics 76 Evaluation process 87 Establish evaluation requirements.97.1 Establish the purpose of evaluation97.2 Identify types of product(s) to be evaluated .117.3 Specify quality model138 Specify the evaluation .148.1 Select metrics.148.2 Establish rating le
28、vels for metrics.158.3 Establish criteria for assessment169 Design the evaluation 169.1 Produce evaluation plan.1610 Execute the evaluation 1610.1Take measures.1610.2Compare with criteria1710.3Assess results 1711 Supporting processes .17Bibliography18ISO/IEC ISO/IEC 14598-1:1999(E)iiiForewordISO (th
29、e International Organization for Standardization) and IEC (the International ElectrotechnicalCommission) form the specialized system for worldwide standardization. National bodies that aremembers of ISO or IEC participate in the development of International Standards through technicalcommittees esta
30、blished by the respective organization to deal with particular fields of technical activity.ISO and IEC technical committees collaborate in fields of mutual interest. Other internationalorganizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in thework.In the fi
31、eld of information technology, ISO and IEC have established a joint technical committee,ISO/IEC JTC 1. Draft International Standards adopted by the joint technical committee are circulated tonational bodies for voting. Publication as an International Standard requires approval by at least 75 %of the
32、 national bodies casting a vote.International Standard ISO/IEC 14598-1 was prepared by Joint Technical Committee ISO/IEC JTC 1Information technology, Subcommittee SC 7, Software engineering.ISO/IEC 14598-1 is intended for use in conjunction with ISO/IEC 9126-1 (in preparation) which willreplace ISO/
33、IEC 9126 (1991).ISO/IEC 14598 consists of the following parts under the general title Information technology Softwareproduct evaluation : Part 1: General overview Part 2: Planning and management Part 3: Process for developers Part 4: Process for acquirers Part 5: Process for evaluators Part 6: Docum
34、entation of evaluation modulesISO/IEC 14598-1:1999(E)ISO/IECivIntroductionAs the use of information technology grows, the number of critical computer systems also grows. Suchsystems include for example, security critical, life critical, economically critical and safety criticalsystems. The quality o
35、f software in these systems is particularly important because software faults maylead to serious consequences.Throughout the history of software engineering, software quality improvement has been a mostimportant goal. The evaluation of software product quality is vital to both the acquisition anddev
36、elopment of software which meets quality requirements. The relative importance of the variouscharacteristics of software quality depends on the mission or objectives of the system of which it is apart; software products need to be evaluated to decide whether relevant quality characteristics meetthe
37、requirements of the system.The essential parts of software quality evaluation are a quality model, the method of evaluation,software measurement, and supporting tools. To develop good software, quality requirements shouldbe specified, the software quality assurance process should be planned, impleme
38、nted and controlled,and both intermediate products and end products should be evaluated. To achieve objective softwarequality evaluations, the quality attributes of the software should be measured using validated metrics.The term “metric“ has been used in many senses in software engineering publicat
39、ions. In thisinternational standard it is defined as a quantitative scale and method which can be used formeasurement. The word “measure“ is used to refer to the result of a measurement.The ISO/IEC 14598 series of standards give methods for measurement, assessment and evaluation ofsoftware product q
40、uality. They describe neither methods for evaluating software production processesnor methods for cost prediction (software product quality measurements may, of course, be used forboth these purposes).INTERNATIONAL STANDARD ISO/IEC ISO/IEC 14598-1:1999(E)1Information technology Software product eval
41、uation Part 1: General overview1 ScopeThis part of ISO/IEC 14598 introduces the other parts. It provides an overview of the other parts andexplains the relationship between ISO/IEC 14598 and the quality model in ISO/IEC 9126. This part ofISO/IEC 14598 defines the technical terms used in the other pa
42、rts, contains general requirements forspecification and evaluation of software quality and clarifies the general concepts. Additionally, itprovides a framework for evaluating the quality of all types of software product and states therequirements for methods of software product measurement and evalu
43、ation.ISO/IEC 14598 is intended for use by developers, acquirers and independent evaluators, particularlythose responsible for software product evaluation. The evaluation results produced from theapplication of ISO/IEC 14598 can be used by managers and developers/maintainers to measurecompliance to
44、requirements and to make improvements where necessary. The evaluation results canalso be used by analysts to establish the relationships between the internal and external metrics.Process improvement personnel can use the evaluation results to determine how processes can beimproved through study and
45、examination of the projects product quality information.NOTE Much of the guidance in ISO/IEC 14598 is not specific to software, but is also applicable to othercomplex products.2 ConformanceSpecification and evaluation of software conforms to this part of ISO/IEC 14598 if it uses the process inclause
46、 6 and a quality model as required in 8.3. Conformance to ISO/IEC 14598 as a whole shallmean conformance to all applicable published parts of ISO/IEC 14598.3 Normative referencesThe following normative documents contain provisions which, through reference in this text, constituteprovisions of this p
47、art of ISO/IEC 14598. For dated references, subsequent amendments to, orrevisions of, any of these publications do not apply. However, parties to agreements based on this partof ISO/IEC 14598 are encouraged to investigate the possibility of applying the most recent editions ofthe normative documents
48、 indicated below. For undated references, the latest edition of the normativedocument referred to applies. Members of ISO and IEC maintain registers of currently validInternational Standards.ISO/IEC 2382-1:1993, Information technology Vocabulary Part 1: Fundamental terms.ISO 8402:1994, Quality manag
49、ement and quality assurance Vocabulary.ISO/IEC 9126-1:1), Information technology Software quality characteristics and metrics Part 1:Quality characteristics and sub-characteristics.ISO/IEC 12207:1995, Information technology Software life cycle processes._1 To be published. Until this part is published ISO/IEC 9126:1991 should be used.ISO/IEC 14598-1:1999(E)ISO/IEC24 Terms and definitionsFor the purposes of all parts of ISO/IEC 14598, the following definitions apply.4.1acquireran organisation that acqui
