ETSI TS 103 268-4-2017 SmartM2M Smart Appliances Ontology and Communication Framework Testing Part 4 Abstract Test Suite (ATS) and Protocol Implementation eXtra Information for Tes.pdf

1、 ETSI TS 103 268-4 V1.1.1 (2017-04) SmartM2M; Smart Appliances Ontology and Communication Framework Testing; Part 4: Abstract Test Suite (ATS) and Protocol Implementation eXtra Information for Testing (PIXIT) floppy3TECHNICAL SPECIFICATION ETSI ETSI TS 103 268-4 V1.1.1 (2017-04)2 Reference DTS/Smart

2、M2M-103 268-4_SAP_ATS Keywords ATS, IoT, M2M, PIXIT, Smart Appliance, testing ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (

3、06) N 7803/88 Important notice The present document can be downloaded from: http:/www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without

4、 the prior written authorization of ETSI. In case of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the

5、present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at https:/portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comm

6、ent to one of the following services: https:/portal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. T

7、he content of the PDF version shall not be modified without the written authorization of ETSI. The copyright and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2017. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are

8、Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are Trade Marks of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI TS 103 268-4 V1.1.1 (20

9、17-04)3 Contents Intellectual Property Rights 5g3Foreword . 5g3Modal verbs terminology 5g31 Scope 6g32 References 6g32.1 Normative references . 6g32.2 Informative references 7g33 Definitions and abbreviations . 7g33.1 Definitions 7g33.2 Abbreviations . 7g34 Prerequisites and Test Configurations 8g34

10、.1 Test Configurations 8g35 Abstract Test Method (ATM) . 9g35.1 Abstract protocol tester 9g35.2 Test Configuration 9g35.3 Test architecture . 9g35.4 Ports and ASPs (Abstract Services Primitives) 12g35.4.1 Introduction. 12g35.4.2 mcaPort and mccPort 12g35.4.3 utPort 12g35.4.4 acPort 12g35.5 External

11、functions. 13g36 Untestable Test Purposes 13g37 ATS Conventions . 13g37.1 Introduction 13g37.2 Testing conventions 13g37.2.1 Testing states 13g37.2.1.1 Initial state . 13g37.2.1.2 Final state 13g37.3 Naming conventions . 14g37.3.1 Introduction. 14g37.3.2 General guidelines 14g37.3.3 SmartAppliances

12、specific TTCN-3 naming conventions 15g37.3.4 Usage of Log statements . 15g37.3.5 Test Case (TC) identifier 16g3Annex A (normative): Partial PIXIT pro forma . 17g3A.0 The right to copy 17g3A.1 Introduction 17g3A.1 Identification summary. 17g3A.2 ATS summary 17g3A.3 Test laboratory 17g3A.4 Client iden

13、tification 18g3A.5 SUT 18g3A.6 Protocol layer information 18g3A.6.1 Protocol identification 18g3A.7 PIXIT items 18g3ETSI ETSI TS 103 268-4 V1.1.1 (2017-04)4 Annex B (informative): TTCN-3 library modules . 19g3B.1 Electronic annex, zip file with TTCN-3 code 19g3History 20g3ETSI ETSI TS 103 268-4 V1.1

14、.1 (2017-04)5 Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intelle

15、ctual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR Policy, no investigation, includi

16、ng IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Foreword This Technical Specification (TS) has

17、been produced by ETSI Technical Committee Smart Machine-to-Machine communications (SmartM2M). The present document is part 4 of a multi-part deliverable covering Conformance test specifications for Smart Appliances Ontology and Communication Framework Testing, as identified below: Part 1: “Testing m

18、ethodology“; Part 2: “Protocol Implementation Conformance Statement (PICS) pro forma“; Part 3: “Test Suite Structure and Test Purposes (TSS Part 4: “Abstract Test Suite (ATS) and Protocol Implementation eXtra Information for Testing (PIXIT)“. Modal verbs terminology In the present document “shall“,

19、“shall not“, “should“, “should not“, “may“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in d

20、irect citation. ETSI ETSI TS 103 268-4 V1.1.1 (2017-04)6 1 Scope The present document contains the Abstract Test Suite (ATS) for SmartAppliances as defined in ETSI TS 103 264 1 and ETSI TS 103 267 2 in compliance with the relevant requirements and in accordance with the relevant guidance given in IS

21、O/IEC 9646-7 6. The objective of the present document is to provide a basis for conformance tests for SmartAppliances equipment giving a high probability of inter-operability between different manufacturers equipment. The ISO standard for the methodology of conformance testing (ISO/IEC 9646-1 9 and

22、ISO/IEC 9646-2 10) as well as the ETSI rules for conformance testing (ETSI ETS 300 406 11) and the oneM2M Testing methodology ETSI TS 118 115 5 are used as a basis for the test methodology. 2 References 2.1 Normative references References are either specific (identified by date of publication and/or

23、 edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the referenced document (including any amendments) applies. Referenced documents which are not found to be publicly available in the expecte

24、d location might be found at http:/docbox.etsi.org/Reference. The following referenced documents are necessary for the application of the present document. 1 ETSI TS 103 264: “SmartM2M; Smart Appliances; Reference Ontology and oneM2M Mapping“. 2 ETSI TS 103 267: “SmartM2M; Smart Appliances; Communic

25、ation Framework“. 3 ETSI TS 118 104: “oneM2M; Service Layer Core Protocol Specification (oneM2M TS-0004)“. 4 ETSI TS 118 112: “oneM2M; Base Ontology (oneM2M TS-0012)“. 5 ETSI TS 118 115: “oneM2M; Testing Framework (oneM2M TS-0015)“. 6 ISO/IEC 9646-7: “Information technology - Open Systems Interconne

26、ction - Conformance testing methodology and framework - Part 7: Implementation Conformance Statements“. 7 ISO/IEC 9646-6 (1994): “Information technology - Open Systems Interconnection - Conformance testing methodology and framework - Part 6: Protocol profile test specification“. 8 ETSI ES 201 873-1:

27、 “Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 1: TTCN-3 Core Language“. 9 ISO/IEC 9646-1 (1994): “Information technology - Open Systems Interconnection -Conformance testing methodology and framework - Part 1: General concepts“. 10 ISO/IEC 9646-2

28、 (1994): “Information technology - Open Systems Interconnection -Conformance testing methodology and framework - Part 2: Abstract Test Suite specification“. 11 ETSI ETS 300 406 (1995): “Methods for testing and Specification (MTS); Protocol and profile conformance testing specifications; Standardizat

29、ion methodology“. 12 ETSI TS 103 268-2: “SmartM2M; Smart Appliances Ontology and Communication Framework Testing; Part 2: Protocol Implementation Conformance Statement (PICS) proforma“. ETSI ETSI TS 103 268-4 V1.1.1 (2017-04)7 2.2 Informative references References are either specific (identified by

30、date of publication and/or edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the referenced document (including any amendments) applies. NOTE: While any hyperlinks included in this clause wer

31、e valid at the time of publication, ETSI cannot guarantee their long term validity. The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area. Not applicable. 3 Definitions and abbreviations 3.1

32、Definitions For the purposes of the present document, the terms and definitions given in ETSI TS 118 115 5, in ETSI TS 118 112 4 and in ISO/IEC 9646-7 6 apply. 3.2 Abbreviations For the purposes of the present document, the abbreviations given in ETSI TS 118 115 5, ETSI TS 103 264 1, ETSI TS 118 112

33、 4 and the following apply: AE Application entity APT Abstract Protocol Tester ATM Abstract Test Method ATS Abstract Test Suite BI Invalid behaviour BV Valid behaviour CoAP Constrained Application Protocol CSE Common Service Entity HTTP Hypertext Transfer Protocol IP Internet Protocol IPv6 Internet

34、Protocol version 6 IUT Implementation Under Test MQTT Message Queuing Telemetry Transport MTC Main Test Component PA Platform Adapter PCTR Protocol Conformance Test Report PICS Protocol Implementation Conformance Statement PIXIT Partial Protocol Implementation Extra Information for Testing PTC Paral

35、lel Test Component PX PiXit SA System Adapter SAP Service Access Point SUT System Under Test TC Test Case TP Test Purposes TSS Test Suite Structure TTCN Tree and Tabular Combined Notation UT Upper Tester ETSI ETSI TS 103 268-4 V1.1.1 (2017-04)8 4 Prerequisites and Test Configurations 4.1 Test Config

36、urations Figure 4.1-1: Test configuration 1 (CF01) Figure 4.1-2: Test configuration 2 (CF02) Figure 4.1-3: Test configuration 3 (CF03) IUT TEST SYSTEM AE CSE Mca Mcc IUT TEST SYSTEM AE CSE Mca CSE IUT TEST SYSTEM CSE AE Mca ETSI ETSI TS 103 268-4 V1.1.1 (2017-04)9 5 Abstract Test Method (ATM) 5.1 Ab

37、stract protocol tester An abstract protocol tester (APT) is a process that provides behaviours for testing an IUT by emulating a peer IUT at the same layer, and enabling to address a single test objective. APTs used by the SmartAppliances test suite are described in figure 5.1-1. The test system wil

38、l simulate valid and invalid protocol behaviour, and will analyse the reaction of the IUT. System Under TestSAP Test SystemLower LayersEthernetIPTCPHTTPIUTLower LayersEthernetIPTCPHTTPSAP ATSoneM2M messagesLower Layers linkSystem Under TestSAP Test SystemLower LayersEthernetIPTCPCoAPIUTLower LayersE

39、thernetIPTCPCoAPSAP ATSoneM2M messagesLower Layers linkSystem Under TestSAP Test SystemLower LayersEthernetIPTCPMQTTIUTLower LayersEthernetIPTCPMQTTSAP ATSoneM2M messagesLower Layers linkSystem Under TestSAP Test SystemLower LayersEthernetIPTCPWebSocketIUTLower LayersEthernetIPTCPWebSocketSAP ATSone

40、M2M messagesLower Layers link Figure 5.1-1: Abstract protocol testers SmartAppliances As figure 5.1-1 illustrates, the corresponding ATS needs to use lower layers to establish a proper connection to the system under test (SUT) over a physical link (Lower layers link). Three different lower layers ha

41、ve been specified corresponding to the binding protocols considered in oneM2M: HTTP, CoAP, MQTT or WebSocket. 5.2 Test Configuration This test suite uses a unique test configuration in order to cover the different test scenarios. In this configuration, the tester simulates a CSE on Mca interface as

42、defined in Test configuration 3 (CF03) in Figure 4.1-3. 5.3 Test architecture The approach for the implementation of an Abstract Protocol Tester selected in SmartAppliances follows the recommendation of the oneM2M Testing Framework defined in ETSI TS 118 115 5 where the TTCN-3 language and its archi

43、tecture are recommended. Following this recommendation the SmartAppliances tester architecture comprises a non-platform dependent Test Suite, and a platform dependent part. ETSI ETSI TS 103 268-4 V1.1.1 (2017-04)10 Lower Layers linkSAP Conformance TesterSAP Abstract Test SuitePlatform independent De

44、signSAP Test AdapterPlatform dependent* DesignFigure 5.3-1: High level SmartAppliances Test Architecture SmartAppliances TTCN-3 Abstract Test Suite: the test suite is platform independent, and it is the cornerstone of the architecture. It allows a complete decoupling between the test suite and the r

45、est of the test system. The test suite is composed of a complete set of test cases covering SmartAppliances requirements specified by ETSI TS 103 264 1 and ETSI TS 103 267 2. SmartAppliances System Adapter: this is the platform dependent part that includes adapters and codecs (out of the scope of th

46、e present document). This part of the architecture definition depends on the specific platform, operating system and test tool on which the tester is going to run. However, it can be implemented in a semi-independent manner, which will minimize the dependency to those elements. Figure 5.3-2 shows th

47、e SmartAppliances TTCN-3 test architecture design used for the SmartAppliances ATS. The Test Suite needs to interact with the System Adapter to implement the collection of TTCN-3 test cases that are intended to be used to test the SmartAppliances IUTs. The SmartAppliances TTCN-3 test cases implement

48、 the test algorithms specified in the TSS and 2) observe the test events received from the IUT. In TTCN-3 these two interfaces have been implemented through a logical TTCN-3 concept called port (mcaPort and mccPort respectively) which allows oneM2M message primitives exchange with the IUT. ETSI ETSI

49、 TS 103 268-4 V1.1.1 (2017-04)11 Figure 5.3-2: SmartAppliances Test Architecture The oneM2M primitive messages have been mapped into TTCN-3 structure. Through this mapping, the TTCN-3 is able to build and send these messages, as well as receive them via the mcaPort and mccPort. Additionally, the test cases are able to control and configure the test platform through a dedicated port called acPort. To build up a tester, the test platform shall be also developed (out of scope). This test platform is composed of