1、 ETSI TR 101 611 V1.1.1 (2014-06) Intelligent Transport Systems (ITS); Testing; Conformance test specification for CALM Fast Services; FNTP/FSAP/IICP validation report Technical Report ETSI ETSI TR 101 611 V1.1.1 (2014-06) 2Reference DTR/ITS-0020048 Keywords ITS, CALM, testing, validation ETSI 650 R
2、oute des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present document can be downloaded from: http:/www.et
3、si.org The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference in contents bet
4、ween such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Inform
5、ation on the current status of this and other ETSI documents is available at http:/portal.etsi.org/tb/status/status.asp If you find errors in the present document, please send your comment to one of the following services: http:/portal.etsi.org/chaircor/ETSI_support.asp Copyright Notification No par
6、t may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be modified without the written authorization of ETSI. The copyright and the forego
7、ing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2014. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are Trade Marks of ETSI registered for the be
8、nefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI TR 101 611 V1.1.1 (2014-06) 3Contents Intellectual Property Rights 4g3Foreword . 4g3Modal verbs terminology 4g3Introduction 4g31 Scope 5g32 Refere
9、nces 5g32.1 Normative references . 5g32.2 Informative references 5g33 Abbreviations . 6g34 Validation report 6g34.1 Validation level 6g34.2 Source code evaluation . 6g34.2.1 TTCN-3 version 6g34.2.2 TTCN-3 tools used for compilation 7g34.3 Validation process 7g34.3.1 Test platform . 7g34.3.2 Systems
10、under test 7g34.3.3 Validation status . 7g34.3.3.1 FNTP . 7g34.3.3.2 FSAP . 8g34.3.3.3 IICP . 9g34.4 Feedback to standardization process 10g34.4.1 Base standard issues 10g34.4.2 Test specification issues 10g34.4.3 SUT issues 10g3History 11g3ETSI ETSI TR 101 611 V1.1.1 (2014-06) 4Intellectual Propert
11、y Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Esse
12、ntial, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (http:/ipr.etsi.org). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried ou
13、t by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Foreword This Technical Report (TR) has been produced by ETSI Technical Committee I
14、ntelligent Transport Systems (ITS). Modal verbs terminology In the present document “shall“, “shall not“, “should“, “should not“, “may“, “may not“, “need“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for
15、 the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in direct citation. Introduction In response to EC mandate M/453 i.13, ETSI Technical Committee ITS has standardized test specifications for ITS protocols according to base standards from ISO
16、TC204 WG16. In a next step a prototype TTCN-3 test system was built and validated. The present document describes the validation and design of the prototype TTCN-3 test system. The action described in the present document supports the implementation of ITS standards by: Making available validated an
17、d standardized test specifications and thus enabling the application of reliable certification schemes. Executing conformance validation framework against real Implementations Under Test (IUTs) from industry and thus providing these companies a conformance assessment of their implementations. During
18、 the lifetime of this action, the conformance validation framework was as well demonstrated at a meeting of ISO TC204 in Kobe (Japan), and at an ETSI PlugTest. Releasing all software as open source and thus allowing industry to build and run their own conformance validation framework. ETSI ETSI TR 1
19、01 611 V1.1.1 (2014-06) 51 Scope The present document is the validation report of the FNTP, FSAP and IICP conformance tests and it provides statistics of executed and validated FNTP, FSAP and IICP conformance tests. The information provided has been produced by validation against two prototype imple
20、mentations from industry. Furthermore, identified issues related to the base specifications ISO 29281-1 i.5, ISO 24102-5 i.4, ISO 24102-4 i.3 and test specification TS 102 985-1 i.6, TS 102 985-2 i.7, TS 102 985-3 i.8, TS 102 797-1 i.9, TS 102 797-2 i.10, TS 102 797-3 i.11 are listed in the present
21、document. 2 References References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For specific references,only the cited version applies. For non-specific references, the latest version of the referenced document (including any amendme
22、nts) applies. Referenced documents which are not found to be publicly available in the expected location might be found at http:/docbox.etsi.org/Reference. NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee their long term validity. 2.1 Nor
23、mative references The following referenced documents are necessary for the application of the present document. Not applicable. 2.2 Informative references The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a partic
24、ular subject area. i.1 ETSI TR 103 099 (V1.2.1): “Intelligent Transport Systems (ITS); Architecture of conformance validation framework“. i.2 ETSI EG 201 015 (V1.1.1): “Methods for Testing and Specification (MTS); Specification of protocols and services; Validation methodology for standards using SD
25、L; Handbook“. i.3 ISO 24102-4:2013: “Intelligent transport systems -Communications access for land mobiles (CALM) - ITS station management - Part 4: Station-internal management communications“. i.4 ISO 24102-5:2013: “Intelligent transport systems -Communications access for land mobiles (CALM) - ITS
26、station management - Part 5: Fast service advertisement protocol (FSAP)“. i.5 ISO 29281-1:2013: “Intelligent transport systems -Communications access for land mobiles (CALM) - Non-IP communications - Part 1: Fast networking Communications Access for Land Mobiles (CALM); Test specifications for non-I
27、P networking (ISO 29281); Part 1: Protocol Implementation Conformance Statement (PICS) proforma“. i.7 ETSI TS 102 985-2 (V1.2.1): “Intelligent Transport Systems (ITS); Communications Access for Land Mobiles (CALM); Test specifications for non-IP networking (ISO 29281); Part 2: Test Suite Structure a
28、nd Test Purposes (TSS Communications Access for Land Mobiles (CALM); Test specifications for non-IP networking (ISO 29281); Part 3: Abstract Test Suite (ATS) and partial PIXIT proforma“. ETSI ETSI TR 101 611 V1.1.1 (2014-06) 6i.9 ETSI TS 102 797-1 (V1.2.1): “Intelligent Transport Systems (ITS); Comm
29、unications Access for Land Mobiles (CALM); Test specifications for ITS station management (ISO 24102); Part 1: Protocol Implementation Conformance Statement (PICS) specification“. i.10 ETSI TS 102 797-2 (V1.2.1): “Intelligent Transport Systems (ITS); Communications Access for Land Mobiles (CALM); Te
30、st specifications for ITS station management (ISO 24102); Part 2: Test Suite Structure and Test Purposes (TSS Communications Access for Land Mobiles (CALM); Test specifications for ITS station management (ISO 24102); Part 3: Abstract Test Suite (ATS) and partial PIXIT proforma“. i.12 ETSI ES 201 873
31、-1: “Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 1: TTCN-3 Core Language“. i.13 EC mandate M/453: “Standardisation Mandate addressed to CEN, CENELEC and ETSI in the field of information and communication technologies to support the interoperabil
32、ity of co-operative systems for intelligent transport in the European community“. 3 Abbreviations For the purposes of the present document, the following abbreviations apply: ASN Abstract Syntax Notation ATS Abstract Test Suite FNTP Fast Networking the complete suite of tests has been implemented an
33、d executed on two test platform; the suite of tests for implemented protocol options have been executed against SUTs from a range of different suppliers; the operation and output traces of all the tests have been validated. 4.2 Source code evaluation 4.2.1 TTCN-3 version The FSAP, FNTP and IICP abst
34、ract test suites TS 102 985-3 i.8 and TS 102 797-3 i.11 are based on TTCN-3 edition 4.2.1 (TTCN3:2010) specified in ES 201 873-1 i.12. ETSI ETSI TR 101 611 V1.1.1 (2014-06) 74.2.2 TTCN-3 tools used for compilation The test suites TS 102 985-3 i.8 and TS 102 797-3 i.11 have been compiled using three
35、different TTCN-3 tools, as detailed in table 1. Table 1: TTCN-3 tools used for compilation Supplier Tool name Version Settings Compilation result Elvior TestCast T3 6.7.2.1 No error, no warning TestingTech TTworkbench 1.1.17 Support for very large integers ASN.1-Language-Support-v1.1.4 No error, no
36、warning OpenTTCN OpenTTCN Tester 2012 4.2.2 No error, no warning 4.3 Validation process 4.3.1 Test platform The validation test platform is based on the conformance validation framework i.1 and extensions of it presented in TS 102 985-3 i.8 and TS 102 797-3 i.11 using the components presented in tab
37、le 2. Table 2: Validation test platform components TTCN-3 Tool Elvior TestCastT3 v6.7.2.1 TTCN-3 Tool TestingTech TTworkbench v13 with ASN.1 support plugin Test Adapter Software: Implemented by STF424/STF455. ITS Test Adapter v1.1.2 Codec Implemented by STF424/STF455. ITS Codec v1.1.2 4.3.2 Systems
38、under test The following SUTs have been used to validate the FNTP, FSAP and IICP test suites: Table 3: SUTs used for validation Manufacturer Product name Version Commsignia in Hungary FNTP, FSAP and IICP 0.5 Imtech in The Netherlands FNTP, FSAP 2.0 4.3.3 Validation status 4.3.3.1 FNTP Table 4 shows
39、the validation status of each test case of the FNTP abstract test suite. Table 4: Testcase validation status (FNTP) TC identifier Verdict Log analysis Validated TC_FNTP_TXP_BP_BV_01 PASS OK Yes TC_FNTP_TXP_BP_BV_02 PASS OK Yes TC_FNTP_TXP_EP_BV_01 PASS OK Yes TC_FNTP_TXP_EP_BI_01 PASS OK Yes TC_FNTP
40、_RXP_BP_BV_01 PASS OK Yes TC_FNTP_RXP_BP_BV_02 PASS OK Yes TC_FNTP_RXP_BP_BV_03 PASS OK Yes TC_FNTP_RXP_BP_BI_01 PASS OK Yes TC_FNTP_RXP_BP_BI_02 PASS OK Yes ETSI ETSI TR 101 611 V1.1.1 (2014-06) 8TC identifier Verdict Log analysis Validated TC_FNTP_RXP_BP_BI_03 PASS OK Yes TC_FNTP_RXP_EP_BV_01 PASS
41、 OK Yes TC_FNTP_RXP_EP_BV_02 PASS OK Yes TC_FNTP_RXP_EP_BV_03 PASS OK Yes TC_FNTP_RXP_EP_BV_04 PASS OK Yes TC_FNTP_RXP_EP_BI_01 PASS OK Yes TC_FNTP_RXP_EP_BI_02 PASS OK Yes TC_FNTP_TXP_FP_BV_01 Tests not executed due to missing implementations of optional features TC_FNTP_TXP_FP_BV_02 TC_FNTP_TXP_FP
42、_BV_03 TC_FNTP_TXP_FP_BI_01 TC_FNTP_RXP_FP_BV_01 TC_FNTP_RXP_FP_BV_02 TC_FNTP_RXP_FP_BV_03 TC_FNTP_RXP_FP_BV_04 TC_FNTP_RXP_FP_BI_01 TC_FNTP_CIP_EP_BV_01 TC_FNTP_CIP_EP_BV_02 TC_FNTP_CIP_EP_BV_03 TC_FNTP_CIP_EP_BV_04 TC_FNTP_CIP_FP_BV_01 TC_FNTP_CIP_FP_BV_02 TC_FNTP_CIP_FP_BV_03 TC_FNTP_CIP_FP_BV_04
43、 TC_FNTP_CIP_FP_BV_05 TC_FNTP_CIP_FP_BV_06 TC_FNTP_CIP_FP_BV_07 TC_FNTP_CIP_FP_BV_08 TC_FNTP_CIP_FP_BV_01 TC_FNTP_CIP_FP_BV_02 TC_FNTP_CIP_FP_BV_03 4.3.3.2 FSAP Table 5 shows the validation status of each test case of the FNTP abstract test suite. Table 5: Testcase validation status (FSAP) TC identi
44、fier Verdict Log analysis Validated TC_FSAP_SP_HR_BV_01 PASS OK YesTC_FSAP_SP_HR_BV_02 PASS OK Yes TC_FSAP_SP_HR_BV_03 PASS OK YesTC_FSAP_SP_HR_BV_04 PASS OK Yes TC_FSAP_SP_HR_BV_05 PASS OK YesTC_FSAP_SP_HR_BI_01 PASS OK Yes TC_FSAP_SP_HR_BI_02 PASS OK YesTC_FSAP_SU_HR_BV_01 PASS OK Yes TC_FSAP_SU_H
45、R_BV_02 PASS OK YesTC_FSAP_SU_HR_BV_04 PASS OK Yes TC_FSAP_SP_HO_BV_01 Tests not executed due to missing implementations of the host-only role and router-only role of an ITS station unit. All vendors had ITS station units that implement both, the router role and the host role. TC_FSAP_SP_HO_BV_02 TC
46、_FSAP_SP_HO_BV_03 TC_FSAP_SP_HO_BV_04 TC_FSAP_SP_HO_BV_05 TC_FSAP_SP_HO_BI_01 TC_FSAP_SP_HO_BI_02 TC_FSAP_SP_RO_BV_01 TC_FSAP_SP_RO_BV_02 TC_FSAP_SP_RO_BV_03 TC_FSAP_SP_RO_BV_04 TC_FSAP_SP_RO_BV_05 TC_FSAP_SP_RO_BI_01 TC_FSAP_SP_RO_BI_02 ETSI ETSI TR 101 611 V1.1.1 (2014-06) 9TC identifier Verdict L
47、og analysis Validated TC_FSAP_SU_HR_BV_03 TC_FSAP_SU_HR_BV_05 TC_FSAP_SU_HO_BV_01 TC_FSAP_SU_HO_BV_02 TC_FSAP_SU_RO_BV_01 TC_FSAP_SU_RO_BV_02 TC_FSAP_SU_RO_BV_03 4.3.3.3 IICP In a first step, IICP was implicitly tested with all tests performed on FNTP and FSAP, as IICP is used as transport mechanism
48、 between ITS test system and SUT. Table 6 shows the validation status of each test case of the IICP abstract test suite executed explicitly in a second step. Table 6: Testcase validation status (IICP) TC identifier Verdict Log analysis Validated TC_IICP_MGM_BV_01 PASS OK Yes TC_IICP_MGM_BV_02 PASS O
49、K YesTC_IICP_MGM_BV_03 PASS OK Yes TC_IICP_MGM_BV_04 PASS OK YesTC_IICP_MGM_BV_05 PASS OK Yes TC_IICP_MGM_BV_06 PASS OK YesTC_IICP_MGM_BI_01 PASS OK Yes TC_IICP_MGM_BI_02 PASS OK Yes TC_IICP_MGM_BI_03 PASS OK Yes TC_IICP_COMM_BV_01 PASS OK Yes TC_IICP_COMM_BV_02 PASS OK Yes TC_IICP_COMM_BV_03 PASS OK Yes TC_IICP_COMM_BV_04 PASS OK Yes TC_IICP_COMM_BV_05 PASS OK Yes TC_IICP_COMM_BV_06 PASS OK Yes TC_IICP_COMM_BV_07 PASS OK Yes TC_IICP_COMM_BV_08 PASS OK Yes TC_IICP_COMM_BV_09 PASS OK Yes TC_IICP_COMM_BV_10 PAS
