1、 ETSI GS NFV-TST 002 V1.1.1 (2016-10) Network Functions Virtualisation (NFV); Testing Methodology; Report on NFV Interoperability Testing Methodology Disclaimer The present document has been produced and approved by the Network Functions Virtualisation (NFV) ETSI Industry Specification Group (ISG) a
2、nd represents the views of those members who participated in this ISG. It does not necessarily represent the views of the entire ETSI membership. GROUP SPECIFICATION ETSI ETSI GS NFV-TST 002 V1.1.1 (2016-10)2 Reference DGS/NFV-TST002 Keywords interoperability, NFV, testing, methodology ETSI 650 Rout
3、e des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present document can be downloaded from: http:/www.etsi.
4、org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference i
5、n contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of
6、status. Information on the current status of this and other ETSI documents is available at https:/portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comment to one of the following services: https:/portal.etsi.org/People/CommiteeSupportStaff.as
7、px Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be modified without the written authorization of ET
8、SI. The copyright and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2016. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are Trade Mar
9、ks of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI GS NFV-TST 002 V1.1.1 (2016-10)3 Contents Intellectual Property Rights 5g3Foreword . 5g3Modal verbs terminology 5g
10、3Executive summary 5g3Introduction 5g31 Scope 6g32 References 6g32.1 Normative references . 6g32.2 Informative references 6g33 Definitions and abbreviations . 7g33.1 Definitions 7g33.2 Abbreviations . 7g34 Interoperability Testing Methodology Guidelines for NFV . 8 g34.1 Introduction 8g34.2 Basic co
11、ncepts for interoperability testing . 9g34.2.1 Overview 9g34.2.2 System Under Test (SUT) . 9g34.2.3 Function Under Test (FUT) 10g34.2.4 Test interfaces . 10g34.2.5 Test Environment 10g34.2.6 Test Descriptions 10g34.2.7 Test drivers . 11g34.3 Interoperability Test Specifications 11g34.3.1 Overview 11
12、g34.3.2 Generic SUT Architecture 11g34.3.3 Interoperable Features Statement (IFS) 12g34.3.4 SUT Configurations 13g34.3.5 Test Suite Structure . 13g34.3.6 Test Purposes 14g34.3.7 Test Descriptions 14g34.4 Interoperability Testing Process . 17g35 NFV SUT Architecture 18g35.1 NFV Generic SUT Architectu
13、re . 18g35.2 NFV SUT Configuration 1 . 19g35.3 NFV SUT Configuration 2a . 19g35.4 NFV SUT Configuration 2b . 20g35.5 NFV SUT Configuration 3 . 21g35.6 NFV SUT Configuration 4 . 22g36 NFV Interoperability Features 23g36.1 VNF Package Management 23g36.1.1 Description 23g36.1.2 SUT Configuration . 23g3
14、6.1.3 Observed Interfaces 23g36.1.4 Test Interfaces . 24g36.2 Software Image Management . 24g36.2.1 Description 24g36.2.2 SUT Configuration . 24g36.2.3 Observed Interfaces 24g36.2.4 Test Interfaces . 25g36.3 VNF Lifecycle Management 25g36.3.1 Description 25g36.3.2 SUT Configuration . 25g3ETSI ETSI G
15、S NFV-TST 002 V1.1.1 (2016-10)4 6.3.3 Observed Interfaces 25g36.3.4 Test Interfaces . 28g36.4 VNF Configuration Management . 31g36.4.1 Description 31g36.4.2 SUT Configuration . 31g36.4.3 Observed Interfaces 31g36.4.4 Test Interfaces . 31g36.5 VNF Fault Management . 33g36.5.1 Description 33g36.5.2 SU
16、T Configuration . 33g36.5.3 Observed Interfaces 33g36.5.4 Test Interfaces . 33g36.6 VNF Performance Management . 34g36.6.1 Description 34g36.6.2 SUT Configuration . 34g36.6.3 Observed Interfaces 34g36.6.4 Test Interfaces . 35g36.7 Network Service Lifecycle Management . 36g36.7.1 Description 36g36.7.
17、2 SUT Configuration . 37g36.7.3 Observed Interfaces 37g36.7.4 Test Interfaces . 37g36.8 Network Service Fault Management 39g36.8.1 Description 39g36.8.2 SUT Configuration . 39g36.8.3 Observed Interfaces 39g36.8.4 Test Interfaces . 39g36.9 Network Service Performance Management 40g36.9.1 Description
18、40g36.9.2 SUT Configuration . 40g36.9.3 Observed Interfaces 40g36.9.4 Test Interfaces . 41g3Annex A (informative): NFV IFS Pro-forma example 43g3Annex B (informative): Authors Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI S
19、ecretariat. Latest updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updat
20、es on the ETSI Web server) which are, or may be, or may become, essential to the present document. Foreword This Group Specification (GS) has been produced by ETSI Industry Specification Group (ISG) Network Functions Virtualisation (NFV). Modal verbs terminology In the present document “shall“, “sha
21、ll not“, “should“, “should not“, “may“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in direc
22、t citation. Executive summary The present document studies how interoperability test methodology can be applied to NFV by analysing some of the core NFV capabilities and the interactions between the functional blocks defined within the NFV architectural framework required to enable them. Introductio
23、n The present document provides methodology guidelines for interoperability testing of NFV features, starting from a review of some basic concepts for interoperability testing and their fit in an NFV environment and a methodology for the development of interoperability test specifications illustrate
24、d with examples of basic NFV operations. A high level analysis of some core NFV capabilities allows to identify a generic architecture for the associated System Under Test configurations, and to classify some initial Interoperability Feature areas. The present document is organized as follows: Claus
25、e 4 provides an overview of common interoperability concepts and testing methodology guidelines. Clause 5 identifies a generic system under test (SUT) architecture and some initial SUT configurations for interoperability testing of basic NFV capabilities. Clause 6 identifies and analyses some initia
26、l NFV interoperability feature areas and outlines for each of them the impacted functional blocks and interfaces, as well as the applicable SUT configurations described in clause 5. ETSI ETSI GS NFV-TST 002 V1.1.1 (2016-10)6 1 Scope The present document provides some guidelines for NFV interoperabil
27、ity testing and identifies a generic System Under Test (SUT) architecture for NFV, some initial SUT configurations, and some interoperability feature areas derived from core NFV capabilities. 2 References 2.1 Normative references References are either specific (identified by date of publication and/
28、or edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the referenced document (including any amendments) applies. Referenced documents which are not found to be publicly available in the expec
29、ted location might be found at https:/docbox.etsi.org/Reference. NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee their long term validity. The following referenced documents are necessary for the application of the present document. Not
30、 applicable. 2.2 Informative references References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the referenced document (inc
31、luding any amendments) applies. NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee their long term validity. The following referenced documents are not necessary for the application of the present document but they assist the user with reg
32、ard to a particular subject area. i.1 ISO/IEC 9646 (parts 1 to 7): “Information technology - Open Systems Interconnection - Conformance testing methodology and framework“. i.2 ETSI EG 202 237: “Methods for Testing and Specification (MTS); Internet Protocol Testing (IPT); Generic approach to interope
33、rability testing“. i.3 ETSI EG 202 568: “Methods for Testing and Specification (MTS); Internet Protocol Testing (IPT); Testing: Methodology and Framework“. . i.5 ETSI GS NFV 002: “Network Functions Virtualisation (NFV); Architectural Framework“. i.6 ETSI GS NFV-MAN 001: “Network Functions Virtualisa
34、tion (NFV); Management and Orchestration“. i.7 ETSI GS NFV-IFA 010 (V2.1.1): “Network Functions Virtualisation (NFV); Management and Orchestration; Functional requirements specification“. i.8 ETSI GS NFV-IFA 005 (V2.1.1): “Network Functions Virtualisation (NFV); Management and Orchestration; Or-Vi r
35、eference point - Interface and Information Model Specification“. i.9 ETSI GS NFV-IFA 006: “Network Functions Virtualisation (NFV); Management and Orchestration; Vi-Vnfm reference point - Interface and Information Model Specification“. ETSI ETSI GS NFV-TST 002 V1.1.1 (2016-10)7 i.10 ETSI GS NFV-IFA 0
36、07: “Network Functions Virtualisation (NFV); Management and Orchestration; Or-Vnfm reference point - Interface and Information Model Specification“. i.11 ETSI GS NFV-IFA 008: “Network Functions Virtualisation (NFV); Management and Orchestration; Ve-Vnfm reference point - Interface and Information Mo
37、del Specification“. i.12 ETSI GS NFV-IFA 013: “Network Functions Virtualisation (NFV); Management and Orchestration; Os-Ma-Nfvo reference point - Interface and Information Model Specification“. i.13 ETSI GS NFV 003: “Network Functions Virtualisation (NFV); Terminology for main concepts in NFV“. 3 De
38、finitions and abbreviations 3.1 Definitions For the purposes of the present document, the terms and definitions given in ETSI GS NFV 003 i.13 apply. 3.2 Abbreviations For the purposes of the present document, the terms and definitions given in ETSI GS NFV 003 i.13 and the following apply: API Applic
39、ation Programming Interface CON CONformance DUT Device Under Test FUT Function Under Test IFS Interoperable Features Statement IOP InterOPerability IUT Implementation Under Test LCM Life Cycle Management MMI Man-Machine InterfaceNSD Network Service Descriptor OSS Operation System SupportPICS Protoco
40、l Implementation Conformance Statement QE Qualified Equipment QF Qualified FunctionSUT System Under Test TD Test Description TSS Test Suite Structure VNFFG Virtual Network Function Forwarding Graph ETSI ETSI GS NFV-TST 002 V1.1.1 (2016-10)8 4 Interoperability Testing Methodology Guidelines for NFV 4
41、.1 Introduction Well established test methodology like ETSI EG 202 237 i.2 and ETSI EG 202 568 i.3 describe two main and complementary ways of testing devices implementing standardized services, which each have benefits and limitations: Conformance Testing can show that a product correctly implement
42、s a particular standard, that is, it establishes whether or not the Implementation Under Test (IUT) meets the requirements specified by the standard. For example, it will test protocol message contents and format as well as the permitted sequences of messages. In this context: - There is only one Im
43、plementation Under Test, which is part of the System Under Test. - Tests are performed at open standardized interfaces which might not be accessible to an end user, and executed by a dedicated test system that has full control of the System Under Test and the ability to observe all incoming and out
44、coming communications. - The high degree of control of the test system over the sequence and contents of the protocol messages allows to test both valid and invalid behaviour. Figure 1: Conformance testing Interoperability Testing can demonstrate that a product will work with other like products: it
45、 proves that end-to-end functionality between (at least) two functions is as required by the standard(s) on which those functions are based. In this context: - The System Under Test (SUT) is made of the combination of different Functions Under Test (FUT) coming from different suppliers. - Interopera
46、bility tests are based on functionality as experienced by a user, where the user may be human or a software application. - Tests are performed and observed at functional interfaces such as Man-Machine Interfaces (MMIs), protocol service interfaces and Application Programming Interfaces (APIs). - Tes
47、ting at functional interfaces implies that interoperability tests can only describe functional behaviour and sometimes it might not be possible to trigger or test protocol error behaviour on the interface(s) among the FUTs. Figure 2: Interoperability testing NOTE: The concept of Function Under Test
48、used in the present document corresponds to the concept of Device Under Test (DUT) introduced in ETSI EG 202 568 i.3. ETSI ETSI GS NFV-TST 002 V1.1.1 (2016-10)9 Conformance testing in conjunction with interoperability testing provides both the proof of conformance and the guarantee of interoperation
49、. ETSI EG 202 237 i.2 and ETSI EG 202 568 i.3 describe several approaches on how to combine the two methods, the most common one being Interoperability Testing with Conformance Checks, where reference points between the FUTs are monitored to verify the appropriate sequence and contents of protocol messages, API calls, interface operations, etc. Clauses 4.2 to 4.4 provide an overview of the main concepts and practices associated with interoperability testing. The intention is to develop simple and pragmatic guidelines that can be
