ETSI TR 126 909-2017 Universal Mobile Telecommunications System (UMTS) LTE Study on improved streaming Quality of Experience (QoE) reporting in 3GPP services and networks (V14 0 0 .pdf

1、 ETSI TR 126 909 V14.0.0 (2017-04) Universal Mobile Telecommunications System (UMTS); LTE; Study on improved streaming Quality of Experience (QoE) reporting in 3GPP services and networks (3GPP TR 26.909 version 14.0.0 Release 14) TECHNICAL REPORT ETSI ETSI TR 126 909 V14.0.0 (2017-04)13GPP TR 26.909

2、 version 14.0.0 Release 14Reference DTR/TSGS-0426909ve00 Keywords LTE,UMTS ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06)

3、 N 7803/88 Important notice The present document can be downloaded from: http:/www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without th

4、e prior written authorization of ETSI. In case of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the pre

5、sent document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at https:/portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comment

6、 to one of the following services: https:/portal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The

7、content of the PDF version shall not be modified without the written authorization of ETSI. The copyright and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2017. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Tra

8、de Marks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are Trade Marks of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI TR 126 909 V14.0.0 (2017-0

9、4)23GPP TR 26.909 version 14.0.0 Release 14Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found

10、 in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR Poli

11、cy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Foreword This Tech

12、nical Report (TR) has been produced by ETSI 3rd Generation Partnership Project (3GPP). The present document may refer to technical specifications or reports using their 3GPP identities, UMTS identities or GSM identities. These should be interpreted as being references to the corresponding ETSI deliv

13、erables. The cross reference between GSM, UMTS, 3GPP and ETSI identities can be found under http:/webapp.etsi.org/key/queryform.asp. Modal verbs terminology In the present document “should“, “should not“, “may“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in

14、 clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in direct citation. ETSI ETSI TR 126 909 V14.0.0 (2017-04)33GPP TR 26.909 version 14.0.0 Release 14Contents Intellectual Property Rights

15、 2g3Foreword . 2g3Modal verbs terminology 2g3Foreword . 4g31 Scope 5g32 References 5g33 Abbreviations . 5g34 A/V Quality Monitoring Support for 3GPP PSS 6g34.1 WebTV Quality Monitoring . 6g34.1.1 Use case 6g34.1.2 Potential Recommended requirements 7g34.2 ITU-T P.NATS Quality Assessment Model for HT

16、TP Adaptive Streaming . 9g34.3 Gap analysis of PSS QoE metrics for support of ITU-T P.NATS 11g34.3.1 Supported Mode 11g34.3.2 Supported Input parameter 11g34.3.3 Further Parameters for Supporting Video Quality Monitoring . 15g34.3.3.1 Additional Input Parameters 15g34.3.3.2 Dependency of Video Quali

17、ty Test Results on Visual Size 15g34.3.3.3 Relation between Video Quality MOS and QP Parameter 16g34.4 Calculation of A/V MOS estimation 17g34.4.0 General 17g34.4.1 Network Optimization 17g34.4.2 MOS Models . 17g34.4.3 MOS Windowing 17g34.4.4 Conclusion 18g34.5 Options for applying higher P.NATS Mod

18、es . 18g35 QoE metrics support for managed streaming service . 20g35.1 Use case: Managed Streaming Service QoE Improvement 20g35.1.1 Introduction. 20g35.1.2 Use case #1 . 20g35.1.3 Use case #2 . 21g35.2 Managed streaming service deployment model consideration . 21g35.2.1 Introduction. 21g35.2.2 Mana

19、ged streaming service deployment model 22g35.3 Recommended requirements 23g35.4 GAP Analysis and Evaluation 23g35.4.1 Introduction. 23g35.4.2 Analysis of Activation/Deactivation of QoE reporting . 23g35.5 Assumptions . 24g35.6 Solution 24g35.6.1 Possible Candidate Options 24g35.6.2 QoE metrics colle

20、ction within a certain geographic area 26g35.6.3 QoE metrics collection of a streaming service of a specific 3rd party 26g35.7 QoE Handler API Considerations 26g35.8 Privacy issue on QoE metric collection 28g35.8.1 Analysis 28g35.8.2 Solutions . 28g36 Conclusion 28g3Annex A: Change history 30g3Histo

21、ry 31g3ETSI ETSI TR 126 909 V14.0.0 (2017-04)43GPP TR 26.909 version 14.0.0 Release 14Foreword This Technical Report has been produced by the 3rdGeneration Partnership Project (3GPP). The contents of the present document are subject to continuing work within the TSG and may change following formal T

22、SG approval. Should the TSG modify the contents of the present document, it will be re-released by the TSG with an identifying change of release date and an increase in version number as follows: Version x.y.z where: x the first digit: 1 presented to TSG for information; 2 presented to TSG for appro

23、val; 3 or greater indicates TSG approved document under change control. y the second digit is incremented for all changes of substance, i.e. technical enhancements, corrections, updates, etc. z the third digit is incremented when editorial only changes have been incorporated in the document. ETSI ET

24、SI TR 126 909 V14.0.0 (2017-04)53GPP TR 26.909 version 14.0.0 Release 141 Scope The present document describes the enhancement of Quality of Experience (QoE) for operator managed streaming service, 3rdparty managed streaming service and Over-The-Top (OTT) streaming service. 2 References The followin

25、g documents contain provisions which, through reference in this text, constitute provisions of the present document. - References are either specific (identified by date of publication, edition number, version number, etc.) or non-specific. - For a specific reference, subsequent revisions do not app

26、ly. - For a non-specific reference, the latest version applies. In the case of a reference to a 3GPP document (including a GSM document), a non-specific reference implicitly refers to the latest version of that document in the same Release as the present document. 1 3GPP TR 21.905: “Vocabulary for 3

27、GPP Specifications“. 2 Yiting Liao, et al. “Achieving high QoE across the compute continuum: How compression, content, and devices interact.“ 7th International Workshop on Video Processing and Quality Metrics for Consumer Electronics, Scottsdale, Arizona, USA. 2013. 3 ITU-T SG12 “T13-SG12-150505-TD-

28、GEN-0671!R1!MSW-E-P.NATS Terms of Reference (ToR)“. 4 3GPP TS 26.247: “Transparent end-to-end Packet-switched Streaming Service (PSS); Progressive Download and Dynamic Adaptive Streaming over HTTP (3GP-DASH)“. 5 3GPP TS 26.233: “Transparent end-to-end packet switched streaming service (PSS); General

29、 description“. 6 3GPP TR 26.938: “Packet-switched Streaming Service (PSS); Improved support for dynamic adaptive streaming over HTTP in 3GPP“. 7 3GPP TS 26.244: “Transparent end-to-end packet switched streaming service (PSS); 3GPP file format (3GP)“. 8 Recommendation ITU-R BT.500: “Methodology for t

30、he subjective assessment of the quality of television pictures“. 9 DASH-IF Position Paper: “Proposed QoE Media Metrics standardization for segmented media playback“: http:/dashif.org/wp-content/uploads/2016/10/ProposedMediaMetricsforSegmentedMediaDelivery-r12.pdf 10 ISO/IEC 23001-10: “Information te

31、chnology - MPEG systems technologies - Part 10: Carriage of timed metadata metrics of media in ISO base media file format“. 11 3GPP TS 32.422: “Telecommunication management; Subscriber and equipment trace; Trace control and configuration management“. 3 Abbreviations For the purposes of the present d

32、ocument, the abbreviations given in 3GPP TR 21.905 1 and the following apply. An abbreviation defined in the present document takes precedence over the definition of the same abbreviation, if any, in 3GPP TR 21.905 1. A/V MOS Audio/Video Mean Opinion Score ETSI ETSI TR 126 909 V14.0.0 (2017-04)63GPP

33、 TR 26.909 version 14.0.0 Release 14IQoE Improved Quality of Experience DASH Dynamic Adaptive Streaming over HTTP KPI Key Performance Indicators KQI Key Quality Indicator MDT Minimization of Drive Tests MNO Mobile Network Operator MOS Mean Opinion Score MOS-AVQO Audio-Visual-Quality-Objective MPD Me

34、dia Presentation Description OTT Over The Top PSS Packet Streaming Server TCE Trace Collection Entity VSSQM Video Streaming Service Quality Monitoring 4 A/V Quality Monitoring Support for 3GPP PSS 4.1 WebTV Quality Monitoring 4.1.1 Use case Over-The-Top video streaming is increasingly dominating the

35、 traffic in the networks. An increasing number of services employing a variety of streaming formats are appearing. In addition, movie services are increasingly causing traffic in mobile networks. It is crucial for mobile network operators to manage the video traffic in their networks and services in

36、 an optimal manner. A major objective is to ensure that the customers remain satisfied. Hence monitoring the users QoE with an appropriate quality indicator is of fundamental importance. The derivation of quality indicators for the streaming quality may be supported by the service to a lesser or gre

37、ater extend. Further dedicated agreements between mobile operator and service provider would help to obtain better quality indicators. The level of accuracy on the quality indicator would depend on the level of agreement between the mobile network operator and the service provider. The main Key Perf

38、ormance Indicators (KPIs) for characterizing insufficient video streaming performance as perceived by the user are: - initial stalling of the playout; - periods of stalling and freezing of the video while playing; - interruption of the audio while playing; - low coding quality appearing as blurring,

39、 macroblocking or mosquito artefacts; - varying coding quality while playing. Beside these KPIs the monitoring system will also provide a Key Quality Indicator (KQI) characterizing the users quality experience. Quality is fundamentally related to the subjective assessment of the considered aspect. T

40、he KQI will be related to corresponding subjective quality assessments. The quality often is rated as an opinion score on a 5-point scale ranging from “bad“ (1), “poor“ (2), “fair“ (3), “good“ (4) to “excellent“ (5). The average of these scores calculated from a group of subjects is the Mean Opinion

41、 Score (MOS). For operational tasks instrumental measurement tools are required. Hence, the subjective test results are used to develop instrumental methods that replicates the MOS scores obtained in subjective tests. Ideally, the derived quality model will be established as internationally agreed s

42、tandard specification, for increasing the confidence that the measured quality results are reliable and comparable. The estimated MOS values will be labelled as result stemming from an objective model. For example, the estimated AV-streaming MOS could be named MOS-AVQO (Audio-Visual-Quality-Objectiv

43、e). ETSI ETSI TR 126 909 V14.0.0 (2017-04)73GPP TR 26.909 version 14.0.0 Release 14The use of a KQI, estimating the MOS of a video streaming session has the major advantage of combining the quality impact of occurring stalling and coding effects in a single number. By this means the service can be m

44、onitored efficiently. In addition to the KPIs and KQI, further the related data such as time, location, service and network will be collected for each considered streaming session. The use case “WebTV Quality Monitoring“ demands for means that allow collecting accurate KPIs and the audio-visual KQI

45、for supporting the quality management of the networks and customer services. The collected KPI and KQI data supports a wide range of utilizations such as the short-term detection of problems and the long term quality monitoring. With additional other monitoring data sources, the complete delivery ch

46、ain, from server, via networks, to the users terminal can be observed. Data analytics methods can be applied to reveal inherent quality dependencies. The detection of critical combinations of KPIs with the help of a KQI focuses on the users quality experience and is therefore very efficient. In conc

47、lusion, the MOS-AVQO is foreseen as mean to increase the usefulness of the quality monitoring systems significantly. 4.1.2 Potential Recommended requirements The proposed potential requirements for implementing the WebTV Quality Monitoring use case are based on the assumption that the users end devi

48、ce is collecting and aggregating the QoE-related data. The collected QoE-related data then is further processed and forwarded to a central QoE monitoring server in a next step: - The monitoring software of the end device can provide a generic applicable subsystem for Video Streaming Service Quality

49、Monitoring (VSSQM). - The VSSQM subsystem provides an API for logging QoE related events. The API provides a handler for receiving and digesting QoE related events and for retrieval of QoE-related data to be reported to a QoE Server using an appropriate communication channel. - VSSQM subsystem provides an API for third party QoE monitoring applications running on the end device. This API allows retrieving the aggregated QoE-related data. The QoE monitoring application may transmit the QoE-related data to a third party QoE Monitoring Service. F