1、Systems and software engineering Guideline for the evaluation and selection of software engineering tools BS ISO/IEC 20741:2017 BSI Standards Publication WB11885_BSI_StandardCovs_2013_AW.indd 1 15/05/2013 15:06Systems and software engineering Guideline for the evaluation and selection of software en
2、gineering tools Ingnierie des systmes et du logiciel Lignes directrices pour lvaluation et le choix des outils dingnierie logicielle INTERNATIONAL STANDARD ISO/IEC 20741 Reference number ISO/IEC 20741:2017(E) First edition 2017-05 ISO/IEC 2017 National foreword This British Standard is the UK implem
3、entation of ISO/IEC 20741:2017. The UK participation in its preparation was entrusted to Technical Committee IST/15, Software and systems engineering. A list of organizations represented on this committee can be obtained on request to its secretary. This publication does not purport to include all t
4、he necessary provisions of a contract. Users are responsible for its correct application. The British Standards Institution 2017 Published by BSI Standards Limited 2017 ISBN 978 0 580 92827 7 ICS 35.080Compliance with a British Standard cannot confer immunity from legal obligations. This British Sta
5、ndard was published under the authority of the Standards Policy and Strategy Committee on 31 July 2017. Amendments/corrigenda issued since publication Date Text affected BRITISH STANDARD BS ISO/IEC 20741:2017Systems and software engineering Guideline for the evaluation and selection of software engi
6、neering tools Ingnierie des systmes et du logiciel Lignes directrices pour lvaluation et le choix des outils dingnierie logicielle INTERNATIONAL STANDARD ISO/IEC 20741 Reference number ISO/IEC 20741:2017(E) First edition 2017-05 ISO/IEC 2017 BS ISO/IEC 20741:2017 ii ISO/IEC 2017 All rights reserved
7、COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2017, Published in Switzerland All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on the internet or an int
8、ranet, without prior written permission. Permission can be requested from either ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Ch. de Blandonnet 8 CP 401 CH-1214 Vernier, Geneva, Switzerland Tel. +41 22 749 01 11 Fax +41 22 749 09 47 copyrightiso.
9、org www.iso.org ISO/IEC 20741:2017(E) BS ISO/IEC 20741:2017 ii ISO/IEC 2017 All rights reserved COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2017, Published in Switzerland All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized otherwise in any form or by a
10、ny means, electronic or mechanical, including photocopying, or posting on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Ch. de Blandonnet 8 CP 4
11、01 CH-1214 Vernier, Geneva, Switzerland Tel. +41 22 749 01 11 Fax +41 22 749 09 47 copyrightiso.org www.iso.org ISO/IEC 20741:2017(E)ISO/IEC 20741:2017(E)Foreword v Introduction vi 1 Scope . 1 2 Normative references 2 3 T erms and definitions . 2 4 Abbreviated terms 3 5 Overview of evaluation and se
12、lection of software engineering tools 3 5.1 Introduction of the evaluation and selection of software engineering tools. 3 5.2 Framework of the evaluation and selection of software engineering tools . 4 5.3 General process considerations . 4 5.3.1 Sequencing of processes . 4 5.3.2 Reducing cost and r
13、isk 5 6 Preparation process 5 6.1 Purpose 5 6.2 Outcomes . 6 6.3 Activities and tasks 6 6.3.1 Goal setting . 6 6.3.2 Establishing selection criteria 7 6.3.3 Project planning and control . 7 7 Structuring process . 8 7.1 Purpose 8 7.2 Outcomes . 8 7.3 Activities and tasks 9 7.3.1 Requirements definit
14、ion . 9 7.3.2 Software engineering tool information gathering .10 7.3.3 Identifying final candidate software engineering tools 11 8 Evaluation process .11 8.1 Purpose .11 8.2 Outcomes 12 8.3 Activities and tasks .12 8.3.1 Preparing for evaluation 12 8.3.2 Evaluating software engineering tools 13 8.3
15、.3 Evaluation reporting 14 9 Software engineering tool selection process .14 9.1 Purpose .14 9.2 Outcomes 15 9.3 Activities and tasks .15 9.3.1 Preparing for selection 15 9.3.2 Applying the selection algorithm .15 9.3.3 Recommending a selection decision 15 9.3.4 Validating the selection decision 15
16、10 General software tool characteristics 16 10.1 Overview .16 10.2 Characteristics related to software engineering tool usage functionality 16 10.2.1 Overview 16 10.2.2 Software engineering tool operation environment characteristics 16 10.2.3 Software engineering tool integrability characteristics 1
17、7 10.2.4 Software engineering tool application characteristics 18 10.3 General quality characteristics.20 10.3.1 Overview 20 ISO/IEC 2017 All rights reserved iii Contents Page BS ISO/IEC 20741:2017 ISO/IEC 20741:2017(E)10.3.2 Functional suitability characteristics 20 10.3.3 Performance efficiency ch
18、aracteristics .20 10.3.4 Compatibility characteristics .21 10.3.5 Usability characteristics .21 10.3.6 Reliability characteristics 22 10.3.7 Security characteristics .23 10.3.8 Maintainability characteristics .24 10.3.9 Portability characteristics .25 10.4 General characteristics not related to qual
19、ity .26 10.4.1 Overview 26 10.4.2 Acquisition process characteristics 26 10.4.3 Implementation characteristics .27 10.4.4 Support indicators characteristics 27 10.4.5 Evaluation or certification characteristics 28 Annex A (informative) Examples of selection algorithms .29 Annex B (informative) Evalu
20、ation report contents 32 Bibliography .34 iv ISO/IEC 2017 All rights reserved BS ISO/IEC 20741:2017 ISO/IEC 20741:2017(E)10.3.2 Functional suitability characteristics 20 10.3.3 Performance efficiency characteristics .20 10.3.4 Compatibility characteristics .21 10.3.5 Usability characteristics .21 10
21、.3.6 Reliability characteristics 22 10.3.7 Security characteristics .23 10.3.8 Maintainability characteristics .24 10.3.9 Portability characteristics .25 10.4 General characteristics not related to quality .26 10.4.1 Overview 26 10.4.2 Acquisition process characteristics 26 10.4.3 Implementation cha
22、racteristics .27 10.4.4 Support indicators characteristics 27 10.4.5 Evaluation or certification characteristics 28 Annex A (informative) Examples of selection algorithms .29 Annex B (informative) Evaluation report contents 32 Bibliography .34 iv ISO/IEC 2017 All rights reserved ISO/IEC 20741:2017(E
23、) Foreword ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC participate in the development of International Standards through tech
24、nical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, in liaison with ISO and IEC, also take pa
25、rt in the work. In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. The procedures used to develop this document and those intended for its further maintenance are described in the ISO/IEC Directives, Part 1. In particular the different ap
26、proval criteria needed for the different types of documents should be noted. This document was drafted in accordance with the editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives). Attention is drawn to the possibility that some of the elements of this document may be the
27、 subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. Details of any patent rights identified during the development of the document will be in the Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ pa
28、tents). Any trade name used in this document is information given for the convenience of users and does not constitute an endorsement. For an explanation on the voluntary nature of standards, the meaning of ISO specific terms and expressions related to conformity assessment, as well as information a
29、bout ISOs adherence to the World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see the following URL: www .iso .org/ iso/ foreword .html. This document was prepared by Technical Committee ISO/IEC JTC 1, Information technology, Subcommittee SC 7, Software and systems en
30、gineering. ISO/IEC 2017 All rights reserved v BS ISO/IEC 20741:2017 ISO/IEC 20741:2017(E) Introduction Within systems and software engineering, software engineering tools represent a major part of the supporting technologies used to develop and maintain information technology systems. Their selectio
31、n is carried out with careful consideration of both the technical and management requirements. The objective of an evaluation process is to provide quantitative and comparable results of all candidate alternatives. The final selection can then be based on these results. To be widely useful and accep
32、ted, the software engineering tool evaluation and selection processes are supposed to help both the users and the suppliers of software engineering tools. The more objective, repeatable, and impartial the evaluation and selection processes are, the more widely acceptable they are. The information an
33、d guidance outlined in this document are intended to lead to more cost-effective selections of software engineering tools and to a greater uniformity in how software engineering tool functions and features are described. For evaluating and selecting software engineering tools, a set of processes pro
34、viding a procedure for evaluation and selection, a list of capabilities providing scope of functional requirements, and a list of characteristics providing scope of non-functional requirements are needed. Evaluation and selection of software engineering tools is usually performed within a specific,
35、purpose- oriented tool area for practical reasons, to manage the scope of evaluation and selection. Examples of such tool areas are requirements engineering tools and configuration management tools. Lists of capabilities are tool area specific, but the list of characteristics and the set of evaluati
36、on and selection processes are more generic for all software engineering tool areas. This document defines a set of processes and a list of characteristics which can be used by all software engineering tool areas. This document can be used together with any tool area-specific standard which defines
37、list of capabilities for the tool area. International standards defining lists of capabilities for specific tool areas have been published, such as ISO/IEC 30130 for “software testing tools”, ISO/IEC TR 24766 for “requirements engineering tools”, and ISO/IEC TR 18018 for “configuration management to
38、ols”. Lists of capabilities for other tool areas of software engineering can be developed as a series of standards according to their priority. It is supposed in this document that tool area is decided before starting the evaluation and selection. It is recommended that the decision would be based o
39、n ISO/IEC 15940 which defines the software engineering service for each tool area. This document adopts the general model of software product quality characteristics and sub- characteristics defined in ISO/IEC 25010 and gives additional guidance how to apply the model when the software product is a
40、software engineering tool. The document follows also the software product evaluation model defined in ISO/IEC 25041.vi ISO/IEC 2017 All rights reserved BS ISO/IEC 20741:2017 ISO/IEC 20741:2017(E) Introduction Within systems and software engineering, software engineering tools represent a major part
41、of the supporting technologies used to develop and maintain information technology systems. Their selection is carried out with careful consideration of both the technical and management requirements. The objective of an evaluation process is to provide quantitative and comparable results of all can
42、didate alternatives. The final selection can then be based on these results. To be widely useful and accepted, the software engineering tool evaluation and selection processes are supposed to help both the users and the suppliers of software engineering tools. The more objective, repeatable, and imp
43、artial the evaluation and selection processes are, the more widely acceptable they are. The information and guidance outlined in this document are intended to lead to more cost-effective selections of software engineering tools and to a greater uniformity in how software engineering tool functions a
44、nd features are described. For evaluating and selecting software engineering tools, a set of processes providing a procedure for evaluation and selection, a list of capabilities providing scope of functional requirements, and a list of characteristics providing scope of non-functional requirements a
45、re needed. Evaluation and selection of software engineering tools is usually performed within a specific, purpose- oriented tool area for practical reasons, to manage the scope of evaluation and selection. Examples of such tool areas are requirements engineering tools and configuration management to
46、ols. Lists of capabilities are tool area specific, but the list of characteristics and the set of evaluation and selection processes are more generic for all software engineering tool areas. This document defines a set of processes and a list of characteristics which can be used by all software engi
47、neering tool areas. This document can be used together with any tool area-specific standard which defines list of capabilities for the tool area. International standards defining lists of capabilities for specific tool areas have been published, such as ISO/IEC 30130 for “software testing tools”, IS
48、O/IEC TR 24766 for “requirements engineering tools”, and ISO/IEC TR 18018 for “configuration management tools”. Lists of capabilities for other tool areas of software engineering can be developed as a series of standards according to their priority. It is supposed in this document that tool area is
49、decided before starting the evaluation and selection. It is recommended that the decision would be based on ISO/IEC 15940 which defines the software engineering service for each tool area. This document adopts the general model of software product quality characteristics and sub- characteristics defined in ISO/IEC 25010 and gives additional guidance how to apply the model when the software product is a software engineering tool. The document follows also the software product evaluation model defined in ISO/IEC 25041.vi ISO/I
