1、 ETSI EG 203 341 V1.1.1 (2016-10) Core Network and Interoperability Testing (INT); Approaches for Testing Adaptive Networks ETSI GUIDE ETSI ETSI EG 203 341 V1.1.1 (2016-10)2 Reference DEG/INT-00127 Keywords conformance, interoperability, methodology ETSI 650 Route des Lucioles F-06921 Sophia Antipol
2、is Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present document can be downloaded from: http:/www.etsi.org/standards-search The present docu
3、ment may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference in contents between such versions and/
4、or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current st
5、atus of this and other ETSI documents is available at https:/portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comment to one of the following services: https:/portal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may
6、 be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be modified without the written authorization of ETSI. The copyright and the foregoing r
7、estriction extend to reproduction in all media. European Telecommunications Standards Institute 2016. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are Trade Marks of ETSI registered for the benefit
8、 of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI EG 203 341 V1.1.1 (2016-10)3 Contents Intellectual Property Rights 5g3Foreword . 5g3Modal verbs terminology 5g3Introduction 5g31 Scope 7g32 References
9、7g32.1 Normative references . 7g32.2 Informative references 7g33 Definitions and abbreviations . 8g33.1 Definitions 8g33.2 Abbreviations . 8g34 Definition of Adaptive Networks . 9g34.1 Basic Concept . 9g34.2 General Terminology . 11g34.2.1 Introduction. 11g34.2.2 Network States 11g34.2.3 Static and
10、stationary states 12g34.2.4 State Transitions and Attractors 12g34.3 Adaptive Networks as Network Under Test . 14g35 Entities and interactions . 15g35.1 Overview 15g35.2 Effectors/Activities . 17g35.2.1 User-equivalent activities (type A1) . 17g35.2.1.1 Introduction . 17g35.2.1.2 Systems delivering
11、the required functionality . 17g35.2.2 Structural or other activities (type A2) . 17g35.2.2.1 Introduction . 17g35.2.2.2 Systems delivering the required functionality . 17g35.2.3 Additional controls . 18g35.3 Information/Sensors . 18g35.3.1 Network performance from end user perspective (type I1) 18g
12、35.3.1.1 Introduction . 18g35.3.1.2 Systems delivering the required functionality . 18g35.3.2 Additional information about the network (type I2) . 19g35.3.3 Additional aspects of sensors 19g36 Functional Targets 19g36.1 Introduction 19g36.2 Network stages . 19g36.3 Classes of functional targets . 21
13、g36.4 Applicability of functional targets to network stages . 22g37 Generic Framework and Methods for Testing Adaptive Networks . 22g37.1 Basic Assumptions . 22g37.2 General aspects and related terminology 23g37.3 Testing Process . 23g37.3.1 Introduction. 23g37.3.2 A1 based testing scenarios 23g37.3
14、.3 A2 based testing scenarios 24g37.4 Evaluation of results . 25g3Annex A: Relation to other work done in this field. 26g3A.1 Introduction 26g3ETSI ETSI EG 203 341 V1.1.1 (2016-10)4 A.2 ISG NFV 26g3A.2.1 Group description . 26g3A.2.2 Network Functions Virtualisation (NFV) . 26g3A.3 NTECH AFI . 26g3A
15、.3.1 Group description . 26g3A.3.2 GANA model overview 27g3A.3.3 Concepts of the Generic Test Framework for Testing Adaptive Functions . 27g3History 31g3ETSI ETSI EG 203 341 V1.1.1 (2016-10)5 Intellectual Property Rights IPRs essential or potentially essential to the present document may have been d
16、eclared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, wh
17、ich is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced
18、in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Foreword This ETSI Guide (EG) has been produced by ETSI Technical Committee Core Network and Interoperability Testing (INT). Modal verbs terminology In the present docum
19、ent “should“, “should not“, “may“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in direct cit
20、ation. Introduction The characteristics of “adaptive networks“ such as virtualization, self-organization, self-configuration, self-optimization, self-healing and self-learning, dynamic network slicing promise to offer huge advantages in future networks. While technologies such as Network Functions V
21、irtualisation (NFV), Self-Organizing Networks (SON), Mobile Edge Computing (MEC) and Autonomic Management and Control (AMC) of Networks and Services may not each exhibit all the characteristics they do have one thing in common: they are all dynamic rather than static, reacting to dynamic traffic con
22、ditions, applications, service demands as well as to changes in the eco-system environment. By incorporating one or several of the technologies mentioned above, Adaptive Networks (AN) have the ability to automatically and dynamically manage and control network resources, configuration parameters or
23、the network structure, with limited human intervention, in order to meet functional targets or operational policies. However, to achieve this type of autonomic behaviour, it has to be ensured that any modification that is performed automatically in the network does not produce undesired effects, e.g
24、. instability or lower performance with respect to the end-user perspective. Comprehensive testing, both on a general level as in type approvals and related to acceptance testing of a particular deployment, is therefore even more important than it is for conventional networks. Due to the fact that t
25、he components of an AN may interact in a more complex and interdependent way than in a conventional network, appropriate testing methodologies are required in all phases of operation. For instance, the effect of software updates in network components can be amplified by the more connected nature of
26、these components in an AN. The rest of the present document is organized as follows: Clause 4 gives the definition of an adaptive network, as used in the context of the present document. Clause 5 defines the entities and interactions that may be encountered in an adaptive network. Clause 6 defines t
27、he general functional targets that should be met by adaptive networks. Clause 7 defines the methods that may be used to test adaptive networks. ETSI ETSI EG 203 341 V1.1.1 (2016-10)6 Annex A gives an overview of the relation of the present document to other work performed in this area, e.g. NFV TST,
28、 NTECH-AFI. ETSI ETSI EG 203 341 V1.1.1 (2016-10)7 1 Scope The present document, “Approaches for Testing Adaptive Networks“ defines a framework of testing principles and guidelines that may be used to test networks that exhibit some form of autonomic adaptive behaviour, which allows them to dynamica
29、lly change their configuration, structure or operational parameters. The (re)-configuration is performed in response to stimuli such as changes in workload, operator policies that govern their operation, context (the network is context-aware and may have a degree of self-awareness); and challenges i
30、n the environment (i.e. conditions under which the network is operating, e.g. manifestations of faults, errors, failures in various parts of the network and its hardware and software components). The functionality of individual components and basic interoperability can be ensured at design time. How
31、ever, the complex interactions between various components or functions deployed in a live Adaptive Network (AN) may not be fully assessed or foreseen. Consequently, the document addresses methodologies to test ANs towards meeting their functional targets or policies, and ensuring a minimum trust lev
32、el for autonomic operation of such networks. NOTE: In the literature, both the terms “autonomous“ and “autonomic“ are being used in this context, whereas “autonomous“ appears to indicate a higher level of automation. As adaptive networks are, at the time of writing, surely a technology still at its
33、beginnings, “autonomic“ may be a less ambitious and therefore more appropriate term for the time being. On the other hand, the NGMN 5G White Paper (V1.0) uses the term combination “autonomic/self-management functions“ which points, clearly towards a level beyond “autonomic“. As mobile networks are c
34、omplex systems, it is most likely that the degree of automation will increase in the course of technical evolution, but not in an isotropic way; there will be areas with higher and others with lower levels of automation, and sophistication of respective functions. For these reasons, the present docu
35、ment will use the term “autonomic“. 2 References 2.1 Normative references Normative references are not applicable in the present document. 2.2 Informative references References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For specif
36、ic references, only the cited version applies. For non-specific references, the latest version of the referenced document (including any amendments) applies. NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee their long term validity. The
37、following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area. i.1 ETSI GS AFI 002: “Autonomic network engineering for the self-managing Future Internet (AFI); Generic Autonomic Network Architecture (An
38、Architectural Reference Model for Autonomic Networking, Cognitive Networking and Self-Management)“. i.2 ETSI TS 102 250-4: “Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in mobile networks; Part 4: Requirements for Quality of Service measurement equipment“. i.3 R
39、ecommendation ITU-T P.10/G.100 Amendment 2 (07/2008): “Vocabulary for performance and quality of service Amendment 2: New definitions for inclusion in Recommendation ITU-T P.10/G.100“. i.4 Recommendation ITU-T E.800 (09/2008): “Definitions of terms related to quality of service“. i.5 ISO/IEC 9646: “
40、Information technology - Open Systems Interconnection - Conformance testing methodology and framework“. ETSI ETSI EG 203 341 V1.1.1 (2016-10)8 i.6 ETSI GS NFV-TST 001 (V1.1.1): “Network Functions Virtualisation (NFV); Pre-deployment Testing; Report on Validation of NFV Environments and Services“. i.
41、7 ETSI GS NFV-TST 002: “Network Functions Virtualisation (NFV); Testing Methodology; Report on Interoperability Testing Methodology“. i.8 Dar, K.: “Autonomic Computing: An introduction to MAPE-K reference model“. NOTE: Available at http:/www.uio.no/studier/emner/matnat/ifi/INF5360/v13/undervisningsm
42、ateriale/mape-k.pdf. i.9 IBM (2005):“An architectural blueprint for autonomic computing“. NOTE: Available at http:/ i.10 Hayan, Z.: “A novel autonomic architecture for QoS management in wired network“. NOTE: Available at http:/ieeexplore.ieee.org/xpl/login.jsp?tp= or a continuous (analogue) value. T
43、he totality of all degrees of freedom represents the settings space. Each combination of settings can be described as an N-dimensional vector, where N is the number of degrees of freedom, also called the dimension of the settings space. An individual control setting is then the i-th element of this
44、settings vector. Each possible combination of settings is represented by the corresponding vector. For the purpose of the present document, such a vector is termed Overall Configuration State (OCS). A change of settings - regardless if done by human operators as in conventional networks or by automa
45、tic processes in AN - means a transition between an initial OCS S1to a new OCS S2. g18g381g374g410g396g381g367g3g4g890g258g855g3g898g258g1005g899g18g381g374g410g396g381g367g3g4g890g271g855g3g898g271g1011g899g18g381g374g410g396g381g367g3g4g890g272g855g3g898g272g1005g899g90g286g400g381g437g396g272g286
46、g3g4g90g286g400g381g437g396g272g286g3g4g90g286g400g381g437g396g272g286g3g17g90g286g400g381g437g396g272g286g3g69.g18g381g374g410g396g381g367g3g4g890g258g855g3g898g258g1009g899g18g381g374g410g396g381g367g3g4g890g271g855g3g898g271g1011g899g18g381g374g410g396g381g367g3g4g890g272g855g3g898g272g1007g899g9
47、0g286g400g381g437g396g272g286g3g4g90g286g400g381g437g396g272g286g3g4g90g286g400g381g437g396g272g286g3g17g90g286g400g381g437g396g272g286g3g69 .g75g18g94g3g94g1005g75g18g94g3g94g1006g90g286g400g381g437g396g272g286g3g4g3g18g381g374g296g349g336g437g396g258g410g349g381g374g3g1005 g90g286g400g381g437g396g
48、272g286g3g4g3g18g381g374g296g349g336g437g396g258g410g349g381g374g3g1006Figure 2: Concept of controls and Overall Configuration State (OCS) transitions Also for this purpose and later usage, the term overall network properties (ONP) is defined which describes the appearance of the network as perceiva
49、ble from the end user point of view or through other interfaces to the network operator (see also clause 5.1). Each OCS leads to a specific ONP. NOTE: This relation is not symmetric; several OCS can lead to the same ONP, but the assumption is that the same OCS cannot lead to different ONP. If this was the case it would mean that some aspect of the network shows random behaviour which is a primarily unwanted condition. ETSI ETSI EG 203 341 V1.1.1 (2016-10)12 4.2.3 Static
