ITU-T E 811-2017 Quality measurement in major events (Study Group 12).pdf

1、 I n t e r n a t i o n a l T e l e c o m m u n i c a t i o n U n i o n ITU-T E.811 TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU (03/2017) SERIES E: OVERALL NETWORK OPERATION, TELEPHONE SERVICE, SERVICE OPERATION AND HUMAN FACTORS Quality of telecommunication services: concepts, models, objectives

2、 and dependability planning Models for telecommunication services Quality measurement in major events Recommendation ITU-T E.811 ITU-T E-SERIES RECOMMENDATIONS OVERALL NETWORK OPERATION, TELEPHONE SERVICE, SERVICE OPERATION AND HUMAN FACTORS INTERNATIONAL OPERATION Definitions E.100E.103 General pro

3、visions concerning Administrations E.104E.119 General provisions concerning users E.120E.139 Operation of international telephone services E.140E.159 Numbering plan of the international telephone service E.160E.169 International routing plan E.170E.179 Tones in national signalling systems E.180E.189

4、 Numbering plan of the international telephone service E.190E.199 Maritime mobile service and public land mobile service E.200E.229 OPERATIONAL PROVISIONS RELATING TO CHARGING AND ACCOUNTING IN THE INTERNATIONAL TELEPHONE SERVICE Charging in the international telephone service E.230E.249 Measuring a

5、nd recording call durations for accounting purposes E.260E.269 UTILIZATION OF THE INTERNATIONAL TELEPHONE NETWORK FOR NON-TELEPHONY APPLICATIONS General E.300E.319 Phototelegraphy E.320E.329 ISDN PROVISIONS CONCERNING USERS E.330E.349 INTERNATIONAL ROUTING PLAN E.350E.399 NETWORK MANAGEMENT Internat

6、ional service statistics E.400E.404 International network management E.405E.419 Checking the quality of the international telephone service E.420E.489 TRAFFIC ENGINEERING Measurement and recording of traffic E.490E.505 Forecasting of traffic E.506E.509 Determination of the number of circuits in manu

7、al operation E.510E.519 Determination of the number of circuits in automatic and semi-automatic operation E.520E.539 Grade of service E.540E.599 Definitions E.600E.649 Traffic engineering for IP-networks E.650E.699 ISDN traffic engineering E.700E.749 Mobile network traffic engineering E.750E.799 QUA

8、LITY OF TELECOMMUNICATION SERVICES: CONCEPTS, MODELS, OBJECTIVES AND DEPENDABILITY PLANNING Terms and definitions related to the quality of telecommunication services E.800E.809 Models for telecommunication services E.810E.844 Objectives for quality of service and related concepts of telecommunicati

9、on services E.845E.859 Use of quality of service objectives for planning of telecommunication networks E.860E.879 Field data collection and evaluation on the performance of equipment, networks and services E.880E.899 OTHER E.900E.999 INTERNATIONAL OPERATION Numbering plan of the international teleph

10、one service E.1100E.1199 NETWORK MANAGEMENT International network management E.4100E.4199 For further details, please refer to the list of ITU-T Recommendations. Rec. ITU-T E.811 (03/2017) i Recommendation ITU-T E.811 Quality measurement in major events Summary Recommendation ITU-T E.811 addresses t

11、he quality assessment of mobile broadband and voice services provided during major events, such as FIFA World Cups and Olympic and Paralympic Games, by creating a useful international reference to be considered by operators and regulators when preparing to host such events. History Edition Recommend

12、ation Approval Study Group Unique ID* 1.0 ITU-T E.811 2017-03-01 12 11.1002/1000/13168 Keywords Performance, quality of experience, quality of service. * To access the Recommendation, type the URL http:/handle.itu.int/ in the address field of your web browser, followed by the Recommendations unique

13、ID. For example, http:/handle.itu.int/11.1002/1000/11830-en. ii Rec. ITU-T E.811 (03/2017) FOREWORD The International Telecommunication Union (ITU) is the United Nations specialized agency in the field of telecommunications, information and communication technologies (ICTs). The ITU Telecommunicatio

14、n Standardization Sector (ITU-T) is a permanent organ of ITU. ITU-T is responsible for studying technical, operating and tariff questions and issuing Recommendations on them with a view to standardizing telecommunications on a worldwide basis. The World Telecommunication Standardization Assembly (WT

15、SA), which meets every four years, establishes the topics for study by the ITU-T study groups which, in turn, produce Recommendations on these topics. The approval of ITU-T Recommendations is covered by the procedure laid down in WTSA Resolution 1. In some areas of information technology which fall

16、within ITU-Ts purview, the necessary standards are prepared on a collaborative basis with ISO and IEC. NOTE In this Recommendation, the expression “Administration“ is used for conciseness to indicate both a telecommunication administration and a recognized operating agency. Compliance with this Reco

17、mmendation is voluntary. However, the Recommendation may contain certain mandatory provisions (to ensure, e.g., interoperability or applicability) and compliance with the Recommendation is achieved when all of these mandatory provisions are met. The words “shall“ or some other obligatory language su

18、ch as “must“ and the negative equivalents are used to express requirements. The use of such words does not suggest that compliance with the Recommendation is required of any party. INTELLECTUAL PROPERTY RIGHTSITU draws attention to the possibility that the practice or implementation of this Recommen

19、dation may involve the use of a claimed Intellectual Property Right. ITU takes no position concerning the evidence, validity or applicability of claimed Intellectual Property Rights, whether asserted by ITU members or others outside of the Recommendation development process. As of the date of approv

20、al of this Recommendation, ITU had not received notice of intellectual property, protected by patents, which may be required to implement this Recommendation. However, implementers are cautioned that this may not represent the latest information and are therefore strongly urged to consult the TSB pa

21、tent database at http:/www.itu.int/ITU-T/ipr/. ITU 2017 All rights reserved. No part of this publication may be reproduced, by any means whatsoever, without the prior written permission of ITU. Rec. ITU-T E.811 (03/2017) iii Table of Contents Page 1 Scope . 1 2 References . 1 3 Definitions 2 3.1 Ter

22、ms defined elsewhere 2 3.2 Terms defined in this Recommendation . 2 4 Abbreviations and acronyms 3 5 Conventions 4 6 Traffic forecasting and network dimensioning applied to major events 4 6.1 Considerations for traffic forecasting in major events . 4 6.2 Considerations for network dimensioning in ma

23、jor events 5 7 Strategies of QoS and QoE measurement during major events 5 7.1 Considerations for network quality audit prior the major events . 6 7.2 Considerations for network quality monitoring during major events 6 8 Relevant KPIs to be measured in the context of major events . 7 8.1 Critical KP

24、Is . 7 8.2 Diagnostic KPIs 8 9 Capabilities and levels to assure users satisfaction in the context of major events 8 Appendix I Quality measurement in 2014 FIFA World Cup 10 I.1 Introduction 10 I.2 FIFA World Cup 2014 context . 10 Appendix II Traffic forecasting and network dimensioning in African C

25、up of Nations 2008 17 II.1 Pre-event network audit 17 II.2 Traffic demand estimation 17 II.3 Network resource provisioning and expansion 18 Appendix III Quality measurement in 2016 Summer Olympics 20 III.1 Introduction 20 III.2 2016 Summer Olympics context 20 III.3 Considerations for the assessment

26、of coverage and capacity . 20 Bibliography. 28 iv Rec. ITU-T E.811 (03/2017) Introduction To ensure a quality of service (QoS) and quality of experience (QoE) in mobile broadband and voice services in and around crowded and large venues, with thousands of people sharing pictures, videos and accessin

27、g social networks simultaneously, is a big challenge for operators and regulators worldwide. This scenario comes as a result of the fast penetration of smartphones and the increase of quality thresholds necessary to guarantee user satisfaction. Taking into account that monitoring strategies to be ad

28、opted by regulators are not well defined yet, the efforts to measure QoS and QoE parameters to assure good quality during major events are based more in empiricism than in standards and trusted technical references. The reports from FIFA World Cup Brazil 2014 and Rio 2016 Summer Olympic Games showed

29、 the explosion of voice, data and SMS traffic during the events, not just inside the game venues at the host country but in many regions around the world, due to the massive sharing of pictures and videos in social media and streaming applications. In this scenario, the biggest challenges faced by o

30、perators is to forecast the traffic demand and then deploy an infrastructure that mix 2G, 3G, 4G, 5G and Wi-Fi offloading approaches to ensure the quality of mobile services during the events, especially inside and around the crowded stadiums. Given the lack of technical references for this specific

31、 context of service provision, the successful experiences and main issues faced by the previous host countries is sometimes the unique reference. Rec. ITU-T E.811 (03/2017) 1 Recommendation ITU-T E.811 Quality measurement in major events 1 Scope This Recommendation addresses the quality assessment o

32、f mobile broadband and voice services provided during major events, such as FIFA World Cups and Olympic and Paralympic Games, by creating a useful international reference to be considered by operators and regulators when preparing to host major events. This Recommendation covers the following: 1) tr

33、affic forecasting and network dimensioning applied to major events 2) establishing strategies of QoS and QoE measurements during major events 3) identifying the relevant key performance indicators (KPIs) to be measured 4) establishing network capabilities and reasonable thresholds that should be ach

34、ieved to assure users satisfaction in the context of major events. 2 References The following ITU-T Recommendations and other references contain provisions which, through reference in this text, constitute provisions of this Recommendation. At the time of publication, the editions indicated were val

35、id. All Recommendations and other references are subject to revision; users of this Recommendation are therefore encouraged to investigate the possibility of applying the most recent edition of the Recommendations and other references listed below. A list of the currently valid ITU-T Recommendations

36、 is regularly published. The reference to a document within this Recommendation does not give it, as a stand-alone document, the status of a Recommendation. ITU-T E.800 Recommendation ITU-T E.800 (2008), Definitions of terms related to quality of service. ITU-T E.802 Recommendation ITU-T E.802 (2007

37、), Framework and methodologies for the determination and application of QoS parameters. ITU-T E.803 Recommendation ITU-T E.803 (2011), Quality of service parameters for supporting service aspects. ITU-T E.804 Recommendation ITU-T E.804 (2014), QoS aspects for popular services in mobile networks. ITU

38、-T E.807 Recommendation ITU-T E.807 (2014), Definitions, associated measurement methods and guidance targets of user-centric parameters for call handling in cellular mobile voice services. ITU-T E-800 series ITU-T E-800 series Supplement 9 (2013), Supplement 9 to ITU-T E.800-series Recommendations (

39、Guidelines on regulatory aspects of QoS). ITU-T P.10 Recommendation ITU-T P.10/G.100 (2006), Vocabulary for performance and quality of service. 2 Rec. ITU-T E.811 (03/2017) 3 Definitions 3.1 Terms defined elsewhere This Recommendation uses the following terms defined elsewhere: 3.1.1 benchmark ITU-T

40、 E.804: Evaluation of performance value(s) of a parameter or set of parameters for the purpose of establishing value(s) as the norm against which future performance achievements may be compared or assessed. 3.1.2 call b-ETSI EG 202 009-2: Any connection (fixed or temporary) capable of transferring i

41、nformation between two or more users of a telecommunications system. In this context a user may be a person or a machine. 3.1.3 customer ITU-T E.800: A user who is responsible for payment for the services. 3.1.4 measure ITU-T E.800: A unit by which a parameter may be expressed. 3.1.5 multimedia serv

42、ices ITU-T E.800: A telecommunications service that supports the simultaneous use of multiple media types (e.g., voice, data, video). 3.1.6 network operator ITU-T E.802: An organization that provides and operates a telecommunication network for the purpose of transporting bearers of telecommunicatio

43、n services. 3.1.7 quality of experience ITU-T P.10: The overall acceptability of an application or service, as perceived subjectively by the end-user. NOTE 1 Quality of experience includes the complete end-to-end system effects (client, terminal, network, services infrastructure, etc.). NOTE 2 Overa

44、ll acceptability may be influenced by user expectations and context. 3.1.8 quality of service ITU-T E.800: Totality of characteristics of a telecommunications service that bear on its ability to satisfy stated and implied needs of the user of the service. 3.1.9 service ITU-T E.800: A set of function

45、s offered to a user by an organization. 3.1.10 session ITU-T E.804: Continuous usage of a given service, e.g., a speech call or a data session. 3.2 Terms defined in this Recommendation This Recommendation defines the following terms: 3.2.1 data PoI congestion: The cumulated data session block rate o

46、f all serving cells in the point of interest (PoI), during the desired measurement interval considering all data technologies. 3.2.2 data service availability: The numerical measurement of the service uptime on a data network where network resources for the service are available and functional. Math

47、ematically, Data Service Availability = Service Uptime (hrs) / Service Downtime (hrs) + Service Uptime (hrs). 3.2.3 data session block rate: The ratio of the number of rejected data session requests to the total number of data session requests. 3.2.4 data session drop rate: The ratio of the number o

48、f dropped data sessions to the total number of established data sessions. 3.2.5 delay variation (jitter): The difference between the actual end-to-end delay measured and the minimum end-to-end delay observed. 3.2.6 download/upload data rate: The volume of downloaded/uploaded data traffic per second.

49、 3.2.7 end-to-end delay: The length of time it takes for a data packet to be sent to the destination plus the time it takes for an acknowledgement of that data packet to be received. This is also known as the round-trip time (RTT). Rec. ITU-T E.811 (03/2017) 3 3.2.8 packet data traffic utilization: The ratio of the cumulative utilized packet data resource elements (REs) on the e-NodeBs and EPC to the available packet data resources. 3.2.9 RF traffic channel utilization: The ratio of th