ETSI TS 102 950-2-2017 Methods for Testing and Specification (MTS) TTCN-3 Conformance Test Suite Part 2 Test Suite Structure and Test Purposes (TSS & TP) (V1 6 1 Includes Diskette).pdf

1、 ETSI TS 102 950-2 V1.6.1 (2017-08) Methods for Testing and Specification (MTS); TTCN-3 Conformance Test Suite; Part 2: Test Suite Structure and Test Purposes (TSS Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat.

2、Latest updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ET

3、SI Web server) which are, or may be, or may become, essential to the present document. Trademarks The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners. ETSI claims no ownership of these except for any which are indicated as being the prop

4、erty of ETSI, and conveys no right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks. Foreword This Technical Specification (TS) ha

5、s been produced by ETSI Technical Committee Methods for Testing and Specification (MTS). The present document is part 2 of a multi-part deliverable covering a TTCN-3 conformance test suite, as identified below: Part 1: “Implementation Conformance Statement (ICS)“; Part 2: “Test Suite Structure and T

6、est Purposes (TSS Part 3: “Abstract Test Suite (ATS) and Implementation eXtra Information for Testing (IXIT)“. ETSI ETSI TS 102 950-2 V1.6.1 (2017-08)5 1 Scope The purpose of the present document is to provide Test Suite Structure and Test Purposes (TSS The Testing and Test Control Notation version

7、3; Part 1: TTCN-3 Core Language“. 2 ISO/IEC 9646-1 (1992): “Information Technology - Open Systems Interconnection - Conformance Testing Methodology and Framework - Part 1: General concepts“. 3 ISO/IEC 9646-7 (1994): “Conformance testing methodology and framework - Part 7: Implementation Conformance

8、Statement“. 4 ETSI TS 102 995: “Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Proforma for TTCN-3 reference test suite“. 2.2 Informative references References are either specific (identified by date of publication and/or edition number or version numbe

9、r) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the referenced document (including any amendments) applies. NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee

10、their long term validity. The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area. i.1 ETSI ES 201 873-5: “Methods for Testing and Specification (MTS); The Testing and Test Control Notation ver

11、sion 3; Part 5: TTCN-3 Runtime Interface (TRI)“. i.2 ETSI ES 201 873-6: “Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 6: TTCN-3 Control Interface (TCI)“. i.3 ETSI ES 201 873-7: “Methods for Testing and Specification (MTS); The Testing and Test Co

12、ntrol Notation version 3; Part 7: Using ASN.1 with TTCN-3“. i.4 ETSI ES 201 873-8: “Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 8: The IDL to TTCN-3 Mapping“. ETSI ETSI TS 102 950-2 V1.6.1 (2017-08)6 i.5 ETSI ES 201 873-9: “Methods for Testing a

13、nd Specification (MTS); The Testing and Test Control Notation version 3; Part 9: Using XML schema with TTCN-3“. i.6 ETSI ES 202 781: “Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; TTCN-3 Language Extensions: Configuration and Deployment Support“. i.7 E

14、TSI ES 202 784: “Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; TTCN-3 Language Extensions: Advanced Parameterization“. i.8 ETSI ES 202 785: “Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; TTCN-3 Language E

15、xtensions: Behaviour Types“. 3 Definitions and abbreviations 3.1 Definitions For the purposes of the present document, the terms and definitions given in ISO/IEC 9646-1 2, ISO/IEC 9646-7 3, ETSI ES 201 873-1 1 (TTCN-3) and the following apply: Abstract Test Suite (ATS): test suite composed of abstra

16、ct test cases Implementation Conformance Statement (ICS): statement made by the supplier of an implementation claimed to conform to a given specification, stating which capabilities have been implemented ICS pro forma: document, in the form of a questionnaire, which when completed for an implementat

17、ion or system becomes an ICS Implementation eXtra Information for Testing (IXIT): statement made by a supplier or implementor of an IUT which contains or references all of the information related to the IUT and its testing environment, which will enable the test laboratory to run an appropriate test

18、 suite against the IUT IXIT pro forma: document, in the form of a questionnaire, which when completed for the IUT becomes the IXIT Implementation Under Test (IUT): implementation of one or more OSI protocols in an adjacent user/provider relationship, being part of a real open system which is to be s

19、tudied by testing 3.2 Abbreviations For the purposes of the present document, the following abbreviations apply: ATS Abstract Test Suite ICS Implementation Conformance Statement IUT Implementation under Test IXIT Implementation eXtra Information for Testing TC Test Case TCI TTCN-3 Control Interface

20、TP Test Purpose TRI TTCN-3 Runtime Interface TS Test System TSS Test Suite Structure TSS ETSI ETSI TS 102 950-2 V1.6.1 (2017-08)7 b) positive semantical tests (“Sem“ filename prefix of the test case name); c) negative syntactical tests (“NegSyn“ filename prefix of the test case name); and d) negativ

21、e semantical tests (“NegSem“ filename prefix of the test case name). The execution order of the TTCN-3 tool conformance test cases is specified in the dependencies section of test purpose descriptions. ETSI ETSI TS 102 950-2 V1.6.1 (2017-08)8 Annex A (normative): Description of Test Purposes A.1 Int

22、roduction A.1.1 Test Purposes (TP) For each test requirement a Test Purpose (TP) is defined. Test purposes shall be defined in a dedicated test purpose document as well as with TTCN-3 documentation tags in each test case of the ATS. Both documentations shall convey the same information for each test

23、 purpose. A.1.2 Test purpose naming convention The test purpose naming scheme corresponds to the test case identifier naming scheme and vice-versa. A.1.3 Test purpose structure The test purpose structure is according to the test suite structure (TSS). A.1.4 Test purpose format In the following, exam

24、ples for tabular test purpose descriptions are shown that shall be defined in the test purpose document. This representation is a direct mapping of the contents of the document tags in the ATS (such as purpose, remark, or verdict). The tabular descriptions are presented along with their correspondin

25、g TTCN-3 documentation tag equivalent. The test purpose reference shall be provided in a machine-readable format. Test Purpose Id TP_NegSyn_0501_Identifier Reference ETSI ES 201 873-1 1, Clause 5.1 ICS None Dependencies None Summary Ensure that when the IUT loads a module containing an identifier na

26、med with a keyword then the module is rejected Expected Output Rejection as invalid Notes A corresponding TTCN-3 module addressing TP_NegSyn_0501_Identifier is the following: /* * author STF 521 * version 0.0.1 * purpose 1:5.1, Ensure that when the IUT loads a module containing an identifier named w

27、ith a keyword then the module is rejected. * verdict pass Rejection as invalid */ module NegSyn_0501_Identifier_001 type component GeneralComp testcase TC_NegSyn_0501_Identifier_001() runs on GeneralComp var integer component := 1; control execute(TC_NegSyn_0501_Identifier_001(); ETSI ETSI TS 102 95

28、0-2 V1.6.1 (2017-08)9 Test Purpose Id TP_Syn_0501_Identifier Reference ETSI ES 201 873-1 1, Clause 5.1 ICS None Dependencies None Summary Ensure that the IUT handles the identifiers case sensitively. Expected Output TTCN-3 verdict “pass“ Notes A corresponding TTCN-3 module for TP_Syn_0501_Identifier

29、 is the following: /* * author STF 521 * version 0.0.1 * purpose 1:5.1, Ensure that the IUT handle the identifiers case sensitively. * verdict pass TTCN-3 verdict */ module Syn_0501_Identifier_001 type component IdComp const integer c_int := 0; testcase TC_Syn_0501_Identifier_001() runs on IdComp co

30、nst integer C_INT := 1; if (c_int = 0) setverdict(pass); else setverdict(fail); control execute(TC_Syn_0501_Identifier_001(); A.2 Test purposes for the TTCN-3 conformance test suite The TTCN-3 library modules are contained in archive ts_10295002v010601p0.zip which accompanies the present document. T

31、his ATS has been produced using the Testing and Test Control Notation (TTCN) according to ETSI ES 201 873-1 1. ETSI ETSI TS 102 950-2 V1.6.1 (2017-08)10 History Document history V1.1.1 April 2011 Publication V1.2.1 April 2012 Publication V1.3.1 October 2013 Publication V1.4.1 August 2014 Publication V1.5.1 February 2016 Publication V1.6.1 August 2017 Publication