BS ISO IEC IEEE 29119-3-2013 Software and systems engineering Software testing Test documentation《软件和系统工程 软件测试 试验文件》.pdf

1、BSI Standards Publication Software and systems engineering Software testing Part 3: Test documentation BS ISO/IEC/IEEE 29119-3:2013National foreword This British Standard is the UK implementation of ISO/IEC/IEEE 29119-3:2013. The UK participation in its preparation was entrusted to Technical Committ

2、ee IST/15, Software and systems engineering. A list of organizations represented on this committee can be obtained on request to its secretary. This publication does not purport to include all the necessary provisions of a contract. Users are responsible for its correct application. The British Stan

3、dards Institution 2013. Published by BSI Standards Limited 2013 ISBN 978 0 580 73289 8 ICS 35.080 Compliance with a British Standard cannot confer immunity from legal obligations. This British Standard was published under the authority of the Standards Policy and Strategy Committee on 30 September 2

4、013. Amendments/corrigenda issued since publication Date Text affected BRITISH STANDARD BS ISO/IEC/IEEE 29119-3:2013 Reference number ISO/IEC/IEEE 29119-3:2013(E) ISO/IEC 2013 IEEE 2013INTERNATIONAL STANDARD ISO/IEC/ IEEE 29119-3 First edition 2013-09-01 Software and systems engineering Software tes

5、ting Part 3: Test documentation Ingnierie du logiciel et des systmes Essais du logiciel Partie 3: Documentation des essais BS ISO/IEC/IEEE 29119-3:2013ISO/IEC/IEEE 29119-3:2013(E) COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2013 IEEE 2013 All rights reserved. Unless otherwise specified, no part of this pub

6、lication may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from ISO, IEC or IEEE at the respective address below. ISO copyright office IEC Central Office Institute of Electrical and Electronics Eng

7、ineers, Inc. Case postale 56 3, rue de Varemb 3 Park Avenue, New York CH-1211 Geneva 20 CH-1211 Geneva 20 NY 10016-5997, USA Tel. + 41 22 749 01 11 Switzerland E-mail stds.iprieee.org Fax + 41 22 749 09 47 E-mail inmailiec.ch Web www.ieee.org E-mail copyrightiso.org Web www.iec.ch Web www.iso.org Pu

8、blished in Switzerland ii ISO/IEC 2013 All rights reserved IEEE 2013 All rights reservedBS ISO/IEC/IEEE 29119-3:2013ISO/IEC/IEEE 29119-3:2013(E) ISO/IEC 2013 All rights reserved IEEE 2013 All rights reserved iiiContents Page Foreword . vii Introduction viii 1 Scope 1 2 Conformance . 3 2.1 Intended U

9、sage 3 2.2 Types of conformance 3 2.2.1 Full Conformance 3 2.2.2 Tailored Conformance 3 3 Normative References. 4 4 Terms and Definitions . 4 5 Organizational Test Process Documentation . 9 5.1 Overview . 9 5.2 Test Policy 9 5.2.1 Overview . 9 5.2.2 Document specific information 9 5.2.3 Introduction

10、 10 5.2.4 Test policy statements 10 5.3 Organizational Test Strategy 11 5.4 Overview . 11 5.4.1 Document specific information 12 5.4.2 Introduction 13 5.4.3 Project-wide organizational test strategy statements . 13 5.4.4 Test sub-process-specific organizational test strategy statements 14 6 Test Man

11、agement Processes Documentation 15 6.1 Overview . 15 6.2 Test Plan . 15 6.2.1 Overview . 15 6.2.2 Document specific information 16 6.2.3 Introduction 16 6.2.4 Context of the testing 17 6.2.5 Testing communication 17 6.2.6 Risk register . 18 6.2.7 Test strategy 18 6.2.8 Testing activities and estimat

12、es 20 6.2.9 Staffing . 20 6.2.10 Schedule . 20 6.3 Test Status Report . 21 6.3.1 Overview . 21 6.3.2 Document specific information 21 6.3.3 Introduction 21 6.3.4 Test status 22 6.4 Test Completion Report 23 6.4.1 Overview . 23 6.4.2 Document specific information 23 6.4.3 Introduction 23 6.4.4 Testin

13、g performed . 24 7 Dynamic Test Processes Documentation . 25 7.1 Overview . 25 7.2 Test Design Specification . 26 BS ISO/IEC/IEEE 29119-3:2013ISO/IEC/IEEE 29119-3:2013(E) iv ISO/IEC 2013 All rights reserved IEEE 2013 All rights reserved7.2.1 Overview .26 7.2.2 Document specific information 26 7.2.3

14、Introduction 26 7.2.4 Feature sets 27 7.2.5 Test conditions 28 7.3 Test Case Specification 29 7.3.1 Overview .29 7.3.2 Document specific information 29 7.3.3 Introduction 29 7.3.4 Test coverage items 30 7.3.5 Test cases .31 7.4 Test Procedure Specification .32 7.4.1 Overview .32 7.4.2 Document speci

15、fic information 33 7.4.3 Introduction 33 7.4.4 Test sets .34 7.4.5 Test procedures .34 7.5 Test Data Requirements 35 7.5.1 Overview .35 7.5.2 Document specific information 36 7.5.3 Introduction 36 7.5.4 Detailed test data requirements .37 7.6 Test Environment Requirements .38 7.6.1 Overview .38 7.6.

16、2 Document specific information 38 7.6.3 Introduction 38 7.6.4 Detailed test environment requirements .39 7.7 Test Data Readiness Report .40 7.7.1 Overview .40 7.7.2 Document specific information 40 7.7.3 Introduction 41 7.7.4 Test data status 41 7.8 Test Environment Readiness Report .41 7.8.1 Overv

17、iew .41 7.8.2 Document specific information 42 7.8.3 Introduction 42 7.8.4 Test environment readiness .43 7.9 Actual Results 43 7.10 Test Result 43 7.11 Test Execution Log 44 7.11.1 Overview .44 7.11.2 Document specific information 44 7.11.3 Introduction 44 7.11.4 Events .45 7.12 Test Incident Repor

18、ting .45 7.12.1 Overview .45 7.12.2 Incident Report .46 7.12.3 Document specific information 46 7.12.4 Introduction 46 7.12.5 Incident details .47 Annex A (informative) Overview and Outlines of Documents 49 A.1 Overview .49 A.2 Document Outlines 50 A.2.1 Overview .50 A.2.2 Organizational Test Policy

19、 51 A.2.3 Organizational Test Strategy 51 A.2.4 Test Plan .52 A.2.5 Test Status Report .53 A.2.6 Test Completion Report 53 BS ISO/IEC/IEEE 29119-3:2013ISO/IEC/IEEE 29119-3:2013(E) ISO/IEC 2013 All rights reserved IEEE 2013 All rights reserved vA.2.7 Test Design Specification . 54 A.2.8 Test Case Spe

20、cification 54 A.2.9 Test Procedure Specification . 55 A.2.10 Test Data Requirements . 55 A.2.11 Test Environment Requirements . 56 A.2.12 Test Data Readiness Report . 56 A.2.13 Test Environment Readiness Report 56 A.2.14 Test Execution Log . 56 A.2.15 Incident Report 56 Annex B (informative) ISO/IEC

21、/IEEE 29119-2 Normative Requirements Mapped to ISO/IEC/IEEE 29119-3 Information Items. 58 B.1 Mapping 58 B.1.1 Organizational Test Policy . 58 B.1.2 Organizational Test Strategy 58 B.1.3 Test Plan . 59 B.1.4 Test Status Report . 59 B.1.5 Test Completion Report 60 B.1.6 Test Design Specification . 60

22、 B.1.7 Test Case Specification 60 B.1.8 Test Procedure Specification . 60 B.1.9 Test Data Requirements . 61 B.1.10 Test Environment Requirements . 61 B.1.11 Test Data Readiness Report . 61 B.1.12 Test Environment Readiness Report 61 B.1.13 Test Execution Log . 61 B.1.14 Incident Report 61 Annex C (i

23、nformative) Overview of Examples 63 C.1 Overview . 63 Annex D (informative) Test Policy . 65 D.1 Example 1 Agile Corporation 65 D.2 Example 2 Traditional Ltd 65 Annex E (informative) Organizational Test Strategy . 67 E.1 Example 1 Agile Corporation 67 E.2 Example 2 Traditional Ltd 68 Annex F (inform

24、ative) Test Plan 72 F.1 Example 1 Agile Corporation 72 F.2 Example 2 Traditional Ltd 73 F.2.1 Project Test Plan . 74 F.2.2 System Test Plan . 80 Annex G (informative) Test Status Report 85 G.1 Example 1 Agile Corporation 85 G.2 Example 2 Traditional Ltd 85 Annex H (informative) Test Completion Repor

25、t . 88 H.1 Example 1 Agile Corporation 88 H.2 Example 2 Traditional Ltd 89 Annex I (informative) Test Design Specification . 91 I.1 Example 1 Agile Corporation 91 H.2 Example 2 Traditional Ltd 91 Annex J (informative) Test Case Specification 99 J.1 Example 1 Agile Corporation 99 J.2 Example 2 Tradit

26、ional Ltd 99 Annex K (informative) Test Procedure Specification 104 K.1.1 Example 1.1 Agile Corporation . 104 K.1.2 Example 1.2 Agile Corporation . 104 K.2 Example 2 Traditional Ltd 105 BS ISO/IEC/IEEE 29119-3:2013ISO/IEC/IEEE 29119-3:2013(E) vi ISO/IEC 2013 All rights reserved IEEE 2013 All rights

27、reservedAnnex L (informative) Test Data Requirements 107 L.1 Example 1 Agile Corporation 107 L.2 Example 2 Traditional Ltd . 107 Annex M (informative) Test Environment Requirements . 109 M.1 Example 1 Agile Corporation 109 M.2 Example Traditional Ltd 109 Annex N (informative) Test Data Readiness Rep

28、ort . 111 N.1 Example 1 Agile Corporation 111 N.2 Example 2 Traditional Ltd . 111 Annex O (informative) Test Environment Readiness Report . 112 O.1 Example 1 Agile Corporation 112 O.2 Example 2 Traditional Ltd . 112 Annex P (informative) Actual Results 113 P.1 Example 1 Agile Corporation 113 P.2 Exa

29、mple 2 Traditional 114 Annex Q (informative) Test Result 115 Q.1 Example 1 Agile Corporation 115 Q.2 Example 2 Traditional Ltd . 116 Annex R (informative) Test Execution Log 117 R.1 Example 1 Agile Corporation 117 R.2 Example 2 Traditional Ltd . 117 Annex S (informative) Incident Report . 118 S.1 Ex

30、ample 1 Agile Corporation 118 S.2 Example 2 Traditional Ltd . 119 Annex T (informative) Mappings to Existing Standards . 120 T.1 Mapping to IEEE 829:2008 . 120 T.2 Mapping to ISO/IEC FDIS 15289: 2011 125 T.3 Mapping to BS 7925-2:1998 . 126 T.4 Mapping to ISO/IEC 25051:2006 126 Bibliography . 127 BS

31、ISO/IEC/IEEE 29119-3:2013ISO/IEC/IEEE 29119-3:2013(E) ISO/IEC 2013 All rights reserved IEEE 2013 All rights reserved viiForeword ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization.

32、 National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual int

33、erest. Other international organizations, governmental and non- governmental, in liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. IEEE Standards documents are developed within the IE

34、EE Societies and the Standards Coordinating Committees of the IEEE Standards Association (IEEE-SA) Standards Board. The IEEE develops its standards through a consensus development process, approved by the American National Standards Institute, which brings together volunteers representing varied vie

35、wpoints and interests to achieve the final product. Volunteers are not necessarily members of the Institute and serve without compensation. While the IEEE administers the process and establishes rules to promote fairness in the consensus development process, the IEEE does not independently evaluate,

36、 test, or verify the accuracy of any of the information contained in its standards. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2. The main task of ISO/IEC JTC 1 is to prepare International Standards. Draft International Standards adopted by

37、 the joint technical committee are circulated to national bodies for voting. Publication as an International Standard requires approval by at least 75 % of the national bodies casting a vote. Attention is called to the possibility that implementation of this standard may require the use of subject m

38、atter covered by patent rights. By publication of this standard, no position is taken with respect to the existence or validity of any patent rights in connection therewith. ISO/IEEE is not responsible for identifying essential patents or patent claims for which a license may be required, for conduc

39、ting inquiries into the legal validity or scope of patents or patent claims or determining whether any licensing terms or conditions provided in connection with submission of a Letter of Assurance or a Patent Statement and Licensing Declaration Form, if any, or in any licensing agreements are reason

40、able or non-discriminatory. Users of this standard are expressly advised that determination of the validity of any patent rights, and the risk of infringement of such rights, is entirely their own responsibility. Further information may be obtained from ISO or the IEEE Standards Association. ISO/IEC

41、/IEEE 29119-3 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology, Subcommittee SC 7, Software and systems engineering, in cooperation with the Software & Systems Engineering Standards Committee of the IEEE Computer Society, under the Partner Standards Development Organiz

42、ation cooperation agreement between ISO and IEEE. ISO/IEC 29119 consists of the following standards, under the general title Software and systems engineering Software testing: Part 1: Concepts and definitions Part 2: Test processes Part 3: Test documentation Part 4: Test techniques BS ISO/IEC/IEEE 2

43、9119-3:2013ISO/IEC/IEEE 29119-3:2013(E) viii ISO/IEC 2013 All rights reserved IEEE 2013 All rights reservedIntroduction The purpose of the ISO/IEC/IEEE 29119 series of software testing standards is to define an internationally- agreed set of standards for software testing that can be used by any org

44、anization when performing any form of software testing. This part of ISO/IEC/IEEE 29119, Test Documentation, includes templates and examples of test documentation that are produced during the test process. The templates are arranged within clauses reflecting the overall test process description stru

45、cture in ISO/IEC/IEEE 29119-2 Test Processes, i.e. by the test process in which they are being produced. Annex A contains outlines of the contents of each document. Annex B contains a list of all the information items identified in Clauses 5, 6 and 7 of this part of ISO/IEC/IEEE 29119 with the corre

46、sponding level of conformance (shall/should/may) from ISO/IEC/IEEE 29119-2 Test Processes. Annex C contains an overview of the examples. Annexes D to S contain examples of the application of the templates. Annex T provides mappings to existing standards. The Bibliography for this part of ISO/IEC/IEE

47、E 29119 is at the end of the document. The concepts and vocabulary relating to the software testing documentation are defined in ISO/IEC/IEEE 29119-1 Concepts and Definitions. The actual test process model is defined in ISO/IEC/IEEE 29119-2 Test Processes. It comprises test process descriptions that

48、 define the software testing processes at the organizational level, test management level and dynamic test level. Supporting informative diagrams describing the processes are also provided. Software test design techniques that can be used during test design are defined in ISO/IEC/IEEE 29119-4 Test T

49、echniques. This series of international standards aims to provide stakeholders with the ability to manage and perform software testing in any organization. BS ISO/IEC/IEEE 29119-3:2013INTERNATIONAL STANDARD ISO/IEC/IEEE 29119-3:2013(E) ISO/IEC 2013 All rights reserved IEEE 2013 All rights reserved 1Software and systems engineering Software testing Part 3: Test documentation 1 Scope This part of ISO/IEC/IEEE 29119 specifies s