1、 ETSI TR 102 976 V1.2.1 (2009-12)Technical Report Methods for Testing and Specifications (MTS);Mobile Reference tests for TTCN-3 toolsfloppy3ETSI ETSI TR 102 976 V1.2.1 (2009-12) 2Reference RTR/MTS-001042-MobRefTests Keywords ATS, mobile, testing, TTCN ETSI 650 Route des Lucioles F-06921 Sophia Anti
2、polis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice Individual copies of the present document can be downloaded from: http:/www.etsi.org The prese
3、nt document may be made available in more than one electronic version or in print. In any case of existing or perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF). In case of dispute, the reference shall be the printing on ETSI printers
4、of the PDF version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at http:/portal.etsi.org/tb/sta
5、tus/status.asp If you find errors in the present document, please send your comment to one of the following services: http:/portal.etsi.org/chaircor/ETSI_support.asp Copyright Notification No part may be reproduced except as authorized by written permission. The copyright and the foregoing restricti
6、on extend to reproduction in all media. European Telecommunications Standards Institute 2009. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTM, TIPHONTM, the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM is a Trade Mark of ETSI registered for
7、 the benefit of its Members and of the 3GPP Organizational Partners. LTE is a Trade Mark of ETSI currently being registered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI TR 102 976 V
8、1.2.1 (2009-12) 3Contents Intellectual Property Rights 4g3Foreword . 4g3Introduction 4g31 Scope 5g32 References 5g32.1 Normative references . 5g32.2 Informative references 5g33 Definitions and abbreviations . 6g33.1 Definitions 6g33.2 Abbreviations . 6g34 Concepts of a TTCN-3 tool assurance test sys
9、tem . 7g34.1 General concepts of mirroring 7g34.1.1 Test data 8g34.1.2 Test component configuration 8g34.1.3 Test behaviour 10g34.1.4 Test verdicts 10g34.2 Test system architectures 10g34.2.1 Intra TTCN-3 Executable approach 11g34.2.1.1 Adaptation layer 13g34.2.2 Inter TTCN-3 Executable approach 14g
10、34.2.2.1 Adaptation layer 16g34.2.3 Comparison of the two approaches . 17g35 Abstract Test Suites (ATS). 19g35.1 Test Suite Structure (TSS) 19g35.1.1 Introduction. 19g35.1.2 General assumptions . 19g35.1.3 System Under Test 19g35.1.4 Test Suite Structure . 19g35.2 PICS/PIXIT 20g35.3 TTCN-3 coverage
11、. 20g35.4 The ATS in TTCN-3 core (text) format . 20g3Annex A: Definition of the Inter TTCN-3 Executable interface 21g3A.1 CoDec . 21g3A.2 Test Adaptation 21g3Annex B: Feature coverage details . 23g3Annex C: Using checkpoints to trace the executed paths in the reference ATS . 26g3History 27g3ETSI ETS
12、I TR 102 976 V1.2.1 (2009-12) 4Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR
13、000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (http:/webapp.etsi.org/IPR/home.asp). Pursuant to the ETSI IPR Po
14、licy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Foreword This Te
15、chnical Report (TR) has been produced by ETSI Technical Committee Methods for Testing and Specification (MTS). Introduction The present document consists of two distinct parts. In the first part, concepts of a quality assurance system for Testing and Test Control Notation version 3 (TTCN-3) tools ar
16、e presented. This includes the discussion of general concepts for developing a TTCN-3 mirror test suite for a TTCN-3 reference test suite. In the second part, Abstract Test Suites (ATSs) for a reference TTCN-3 test suite and a mirror TTCN-3 test suite to enable testing of TTCN-3 tools are described.
17、 ETSI ETSI TR 102 976 V1.2.1 (2009-12) 51 Scope The present document describes a test system and underlying reference and mirror tests for assuring the correctness of tools for executing tests that are specified using TTCN-3. The scope is the TTCN-3 Executable (TE) as standardized in ES 201 873-1 i.
18、1 and ES 201 873-4 i.2. For the quality assurance of tools that realise the TE, TTCN-3 test specification that are based on reference tests for the 3G mobile telecommunication system are used. This reference test suite and a corresponding mirror test suite are executed by TTCN-3 tools and run agains
19、t each other to gain confidence in the correctness of the involved TTCN-3 tools. 2 References References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For a specific reference, subsequent revisions do not apply. Non-specific referenc
20、e may be made only to a complete document or a part thereof and only in the following cases: - if it is accepted that it will be possible to use all future changes of the referenced document for the purposes of the referring document; - for informative references. Referenced documents which are not
21、found to be publicly available in the expected location might be found at http:/docbox.etsi.org/Reference. NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee their long term validity. 2.1 Normative references The following referenced docume
22、nts are indispensable for the application of the present document. For dated references, only the edition cited applies. For non-specific references, the latest edition of the referenced document (including any amendments) applies. Not applicable. 2.2 Informative references The following referenced
23、documents are not essential to the use of the present document but they assist the user with regard to a particular subject area. For non-specific references, the latest version of the referenced document (including any amendments) applies. i.1 ETSI ES 201 873-1 (V3.3.2): “Methods for Testing and Sp
24、ecification (MTS);The Testing and Test Control Notation version 3; Part 1: TTCN-3 Core Language“. i.2 ETSI ES 201 873-4 (V3.3.1): “Methods for Testing and Specification (MTS);The Testing and Test Control Notation version 3; Part 4: TTCN-3 Operational Semantics“. i.3 ETSI ES 201 873-5 (V3.3.1): “Meth
25、ods for Testing and Specification (MTS);The Testing and Test Control Notation version 3; Part 5: TTCN-3 Runtime Interface (TRI)“. i.4 ETSI ES 201 873-6 (V3.3.1): “Methods for Testing and Specification (MTS);The Testing and Test Control Notation version 3; Part 6: TTCN-3 Control Interface (TCI)“. i.5
26、 ETSI ES 201 873-7 (V3.3.2): “Methods for Testing and Specification (MTS);The Testing and Test Control Notation version 3; Part 7: Using ASN.1 with TTCN-3“. ETSI ETSI TR 102 976 V1.2.1 (2009-12) 6i.6 ISO/IEC 9646-1 (1994): “Information technology - Open Systems Interconnection - Conformance testing
27、methodology and framework - Part 1: General concepts“. i.7 ISO/IEC 9646-3 (1998): “Information technology - Open Systems Interconnection - Conformance testing methodology and framework - Part 3: The Tree and Tabular Notation (TTCN)“. i.8 ISO/IEC 7498-1 (1994): “Information technology - Open Systems
28、Interconnection - Basic Reference Model: The Basic Model“. i.9 ISO/IEC 10731 (1994): “Information technology - Open System Interconnection - Basic Reference Model: Conventions for the Definition of OSI Services“. (Also published as ITU-T X.210 (11/93). 3 Definitions and abbreviations 3.1 Definitions
29、 For the purposes of the present document, the terms and definitions given in ES 201 873-1 i.1, ES 201 873-5 i.3, ES 201 873-6 i.4, ISO/IEC 9646-1 i.6, ISO/IEC 9646-3 i.7 and the following apply: Main Test Component (MTC): See ISO/IEC 9646-3 i.7. mirror ATS: ATS that serves as an SUT replacement for
30、 the reference ATS by mirroring the reference ATS Parallel Test Component (PTC): See ISO/IEC 9646-3 i.7. reference ATS: existing ATS that is usually (but not necessarily) derived from some base standard System Under Test (SUT): See ISO/IEC 9646-1 i.6. test system: See ISO/IEC 9646-1 i.6. TTCN-3 Cont
31、rol Interface (TCI): See ES 201 873-6 i.4. TTCN-3 Executable (TE): See ES 201 873-5 i.3. TTCN-3 Runtime Interface (TRI): See ES 201 873-5 i.3. 3.2 Abbreviations For the purposes of the present document, the following abbreviations apply: 3GPP 3G Partnership Project AGPS Assisted GPS ASN.1 Abstract S
32、yntax Notation 1 ASP Abstract Service PrimitiveATS Abstract Test Suite CD Coding/Decoding CH Component Handling ETS Executable Test Suite GERAN GSM Edge Radio Access Network MTC Main Test Component OSI Open Systems Interconnection PA Platform Adapter PDU Protocol Data Unit PER Packed Encoding Rules
33、of ASN.1 PTC Parallel Test ComponentRAB Radio Access Bearer RLC Radio Link Control RRC Radio Resource Control SA SUT Adaptor ETSI ETSI TR 102 976 V1.2.1 (2009-12) 7SUT System Under Test TCI TTCN-3 Control Interface TCP Transmission Control Protocol TCP/IP Transmission Control Protocol/Internet Proto
34、col TE TTCN-3 Executable TL Test Logging TM Test ManagementTRI TTCN-3 Runtime Interface TSI Test System Interface TTCN-2 Tree and Tabular Combined Notation version 2 TTCN-3 Testing and Test Control Notation version 3 UDP Unreliable Datagram Protocol XML Extensible Markup Language 4 Concepts of a TTC
35、N-3 tool assurance test system The aim of the TTCN-3 tool assurance test system and the underlying reference tests described in the present document is to assess the standard compliance of TTCN-3 tools in order to improve the exchangeability of TTCN-3 test specifications between TTCN-3 tools from di
36、fferent vendors. In the current approach, the focus is the TTCN-3 Executable (TE) including interpretation or compilation and execution of TTCN-3, i.e. ES 201 873-1 i.1 and ES 201 873-4 i.2 are covered. The additional entities of the general structure of a TTCN-3 test system (such as the TTCN-3 Cont
37、rol Interface (TCI) and the TTCN-3 Runtime Interface (TRI) are not in the scope of the present document. The present document treats TTCN-3 tool assurance in relation to the 3G Partnership Project (3GPP) mobile telecommunication system; hence, existing Tree and Tabular Combined Notation (TTCN-2) tes
38、t cases that have been standardized by 3GPP have been selected and specified as a reference Abstract Test Suite (ATS) in TTCN-3. This includes also Abstract Syntax Notation 1 (ASN.1) modules that are used as described in ES 201 873-7 i.5. This reference test suite can be used to test the standard co
39、mpliance of TTCN-3 tools. For testing the compliance with respect to syntax and static semantics as defined in ES 201 873-1 i.1 (and with respect to ASN.1 also ES 201 873-7 i.5), it is sufficient to let the assessed TTCN-3 tool process the TTCN-3 modules. However, to enable testing of compliance of
40、a TTCN-3 tool with respect to the operational semantics as described in ES 201 873-4 i.2, the reference ATS needs to be executed. For executing the reference ATS, a TTCN-3 test system needs to be realised and another system to communicate with needs to exist. Usually, there is a System Under Test (S
41、UT) against which the TTCN-3 test system is executed. To remove the dependency from a real SUT, the approach described in the present document realises the SUT also by a TTCN-3 test system. As a result, there are two ATSs: the reference ATS and a mirror ATS that mirrors the reference ATS. By running
42、 the TTCN-3 test system that executes the reference ATS and TTCN-3 test system that executes the mirror ATS against each other, a back-to-back test comparable to an interoperability test at PLUGTESTS events is performed. Even though this is a typical interoperability test setup, the setup results fr
43、om a conformance test where the SUT is a TTCN-3 test system that is tested by another TTCN-3 test system. According to the described approach, a mirror ATS needs to be created in addition to the reference ATS. Even though a mirror ATS needs to be individually designed for each reference ATS, some ge
44、neral concepts of mirroring a test suite are described in the next clause. 4.1 General concepts of mirroring As a replacement for the “real“ SUT that is assumed by the reference ATS, the reference ATS is “mirrored“ yielding a mirror ATS. The creation of an ATS as a mirror for an SUT is a standard ap
45、proach in test development. However, for the creation of a mirror ATS for another ATS some special considerations apply. These general concepts of mirroring an ATS are discussed in the following. ETSI ETSI TR 102 976 V1.2.1 (2009-12) 8The process of mirroring a TTCN-3 ATS consists of mirroring relev
46、ant entities, e.g. test case and function definitions, port and component definitions, template definitions, of the reference ATS. To make the relation between mirror definition and reference definition clearer, in the following, the suffix _mirror is added to identifiers of definitions in the mirro
47、r ATS that are a direct mirror of a definition in the reference ATS. This name convention introduces a traceability and increases furthermore the maintenance of e.g. the mirror ATS if the reference ATS is changed. In addition to this naming convention, the approach described in the present document
48、suggests to use a similar TTCN-3 module structure in the mirror ATS as in the reference ATS: those modules of the reference ATS that can be re-used without change are imported by the mirror ATS; however, when it is necessary to change a module, it can be copied, renamed using the suffix _mirror, and
49、 changed as necessary thus resembling the original structure of the reference ATS. The mirroring of definitions refers in particular to those concepts that are related to test data, test component configuration, and test behaviour. Furthermore, when running a mirror ATS against a reference ATS, the meaning of test verdicts needs to be discussed. 4.1.1 Test data In the telecommunication area, the layered OSI Basic Reference Model i.8 is widely used. This includes the usage of a service by means of Abstract Ser
