1、 ETSI TR 1Universal Mobile TelEnd-to-end multime(3GPP TR 26.9TECHNICAL REPORT 126 944 V13.0.0 (2016elecommunications System (LTE; media services performance m.944 version 13.0.0 Release 1316-01) (UMTS); metrics 13) ETSI ETSI TR 126 944 V13.0.0 (2016-01)13GPP TR 26.944 version 13.0.0 Release 13Refere
2、nce RTR/TSGS-0426944vd00 Keywords LTE,UMTS ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The
3、present document can be downloaded from: http:/www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of
4、 ETSI. In case of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware th
5、at the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at http:/portal.etsi.org/tb/status/status.asp If you find errors in the present document, please send your comment to one of the following services: https:/
6、portal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be mo
7、dified without the written authorization of ETSI. The copyright and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2016. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Trade Marks of ETSI registered for the benefi
8、t of its Members. 3GPPTM and LTE are Trade Marks of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI TR 126 944 V13.0.0 (2016-01)23GPP TR 26.944 version 13.0.0 Release 1
9、3Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Propert
10、y Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR Policy, no investigation, including IPR search
11、es, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Foreword This Technical Report (TR) has been produced by ETS
12、I 3rd Generation Partnership Project (3GPP). The present document may refer to technical specifications or reports using their 3GPP identities, UMTS identities or GSM identities. These should be interpreted as being references to the corresponding ETSI deliverables. The cross reference between GSM,
13、UMTS, 3GPP and ETSI identities can be found under http:/webapp.etsi.org/key/queryform.asp. Modal verbs terminology In the present document “shall“, “shall not“, “should“, “should not“, “may“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the E
14、TSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in direct citation. ETSI ETSI TR 126 944 V13.0.0 (2016-01)33GPP TR 26.944 version 13.0.0 Release 13Contents Intellectual Property Rights 2g3Foreword . 2g3Mo
15、dal verbs terminology 2g3Foreword . 7g3Introduction 7g31 Scope 9g32 References 9g33 Abbreviations . 9g34 General description and approach 10g34.1 Definitions 10g34.2 QoE parameters 11g34.3 ESQoS parameters 12g34.4 SQoS parameters 12g35 QoE parameters 14g35.1 General . 14g35.2 Service non-access . 14
16、g35.3 Service failure 14g35.4 Service setting-up time . 14g35.5 Re-buffering . 14g35.6 Image corruption 14g35.7 Edge noise 14g35.8 Blurriness . 15g35.9 Colour reproduction accuracy 15g35.10 Blockiness 15g35.11 Incontinuous image with block 15g35.12 Freeze image 15g35.13 Audio quality 15g35.14 Audio/
17、Video synchronization error 15g36 ESQoS parameters 15g36.1 General . 15g36.2 Service non-availability 16g36.2.1 Abstract definition 16g36.2.2 Equation 16g36.2.3 Trigger point . 16g36.3 Service failure ratio 16g36.3.1 Abstract definition 16g36.3.2 Equation 16g36.3.3 Trigger point . 17g36.4 Initial co
18、nnection time 17g36.4.1 Abstract definition 17g36.4.2 Equation 17g36.4.3 Trigger Point . 17g36.5 Initial buffering time 17g36.5.1 Abstract definition 17g36.5.2 Equation 17g36.5.3 Trigger Point . 18g36.6 Re-buffering frequency 18g36.6.1 Abstract definition 18g36.6.2 Equation 18g36.6.3 Trigger point .
19、 18g36.7 Re-buffering time . 18g3ETSI ETSI TR 126 944 V13.0.0 (2016-01)43GPP TR 26.944 version 13.0.0 Release 136.7.1 Abstract definition 18g36.7.2 Equation 18g36.7.3 Trigger point . 18g36.8 Audio quality 19g36.8.1 Abstract definition 19g36.8.2 Equation 19g36.8.3 Trigger point . 19g36.9 Intra-frame
20、video quality 19g36.9.1 Abstract definition 19g36.9.2 Equation 19g36.9.3 Trigger point . 19g36.10 Inter-frame video quality 20g36.10.1 Abstract definition 20g36.10.2 Equation 20g36.10.3 Trigger point . 20g36.11 Audio/Video de-synchronization error . 20g36.11.1 Abstract definition 20g36.11.2 Equation
21、 20g36.11.3 Trigger point . 20g37 SQoS parameters 21g37.1 SQoS parameters of each layer . 21g37.1.1 Application . 21g37.1.1.1 Frame rate . 21g37.1.1.2 Frame loss ratio . 21g37.1.1.3 Frame error ratio . 21g37.1.1.4 Transaction rate . 21g37.1.1.5 Transaction delay 21g37.1.2 Transport . 21g37.1.2.1 Ban
22、dwidth . 21g37.1.2.2 Transfer delay . 21g37.1.2.3 Jitter. 21g37.1.2.4 Packet loss ratio 21g37.1.2.5 Packet error ratio . 22g37.1.3 Sub-transport. 22g37.1.3.1 Frame loss ratio . 22g37.1.3.2 Residual frame error ratio . 22g37.1.3.3 Frame discard ratio 22g37.1.3.4 Residual bit ratio . 22g37.1.3.5 Acces
23、s delay 22g37.1.3.6 Block ratio . 22g37.1.3.7 Soft handoff rate 22g37.2 SQoS parameters of each class . 22g37.3 SQoS parameters of each service . 23g38 Mapping between ESQoS and SQoS . 24g38.1 General . 24g38.2 PSS . 26g38.3 MBMS 27g38.4 Video telephony . 28g38.5 IMS . 28g3Annex A: PSS Performance A
24、nalysis with Theoretical Models . 31g3A.1 Introduction 31g3A.2 Scope 31g3A.3 References 31g3A.4 General models . 32g3A.4.1 Radio access network model 32g3A.4.1.1 Model description . 32g3A.4.1.2 The block ratio of new calls and the failure ratio of handoff calls 33g3ETSI ETSI TR 126 944 V13.0.0 (2016
25、-01)53GPP TR 26.944 version 13.0.0 Release 13A.4.2 Transport network model . 34g3A.4.2.1 Model description . 34g3A.4.2.2 The mean transfer delay and the transfer time 35g3A.4.3 Node model 35g3A.4.3.1 Simple node model . 35g3A.4.3.1.1 Model description . 35g3A.4.3.1.2 The transaction delay and the da
26、ta loss ratio . 36g3A.4.3.2 Complex node model 36g3A.4.3.2.1 Model description . 36g3A.4.3.2.2 The transaction delay 38g3A.5 Modelling the relationship between ESQoS and SQoS . 39g3A.5.1 Service Non-Availability 39g3A.5.1.1 Relative SQoS and other parameters 39g3A.5.1.2 Model description . 40g3A.5.2
27、 Service Failure Ratio 42g3A.5.2.1 Relative SQoS and other parameters 42g3A.5.2.2 Model description . 43g3A.5.3 Initial Connection Time 45g3A.5.3.1 Relative SQoS and other parameters 45g3A.5.3.2 Model description . 46g3A.5.4 Initial Buffering Time 48g3A.5.4.1 Relative SQoS and other parameters 48g3A
28、.5.4.2 Model description . 49g3A.5.5 Re-Buffering Frequency . 51g3A.5.5.1 Relative SQoS and other parameters 51g3A.5.5.2 Model description . 51g3A.5.6 Re-Buffering Time . 52g3A.5.6.1 Relative SQoS and other parameters 52g3A.5.6.2 Model description . 52g3Annex B: Analysis of QoE . 53g3B.1 Introductio
29、n 53g3B.2 Process 53g3B.2.1 Collection of QoE . 53g3B.2.2 Weightiness of Selected QoE . 53g3B.3 Results 53g3B.3.1 Collection of QoE . 53g3B.3.2 Comparison of Weightiness among Selected QoE Parameters 55g3Annex C: Comparison with TS 102 250 of ETSI STQ Mobile . 56g3C.1 Introduction 56g3C.2 References
30、 56g3C.3 Comparison with 3GPP E2EMSPM and ETSI STQ Mobile . 57g3C.3.1 Research Scope 57g3C.3.1.1 Framework 57g3C.3.1.2 Quality of experience 57g3C.3.1.3 End-to-End Service Quality of Service . 58g3C.3.1.4 System Quality of Service 58g3C.3.1.5 Mapping of End-to-End Service QoS and System QoS 59g3C.3.
31、2 Research Method 59g3C.3.2.1 Statistics Model Analysis 59g3C.3.2.2 Theory Model Analysis of Queue . 60g3C.3.2.3 Possible Further Work 60g3C.4 Brief Introduction of the Work in ETSI STQ . 60g3Annex D: Change history 61g3ETSI ETSI TR 126 944 V13.0.0 (2016-01)63GPP TR 26.944 version 13.0.0 Release 13H
32、istory 62g3ETSI ETSI TR 126 944 V13.0.0 (2016-01)73GPP TR 26.944 version 13.0.0 Release 13Foreword This Technical Report has been produced by the 3GPP. The contents of the present document are subject to continuing work within the TSG and may change following formal TSG approval. Should the TSG modi
33、fy the contents of the present document, it will be re-released by the TSG with an identifying change of release date and an increase in version number as follows: Version 3.y.z where: x the first digit: 1 presented to TSG for information; 2 presented to TSG for approval; 3 Indicates TSG approved do
34、cument under change control. y the second digit is incremented for all changes of substance, i.e. technical enhancements, corrections, updates, etc. z the third digit is incremented when editorial only changes have been incorporated in the specification; Introduction The Quality of Experience (QoE),
35、 End-to-end Service Quality of Service (ESQoS) and System Quality of Service (SQoS) are important factors when introducing services to customers. When the next releases of 3G are launched to the mass market, several new mobile telecommunication multimedia services will be introduced to the general p
36、ublic. It is essential that a high quality if service is experienced by the user of these new 3G services in order to promote the idea of 3G as a global all-purpose communication tool for millions of people with widespread availability of terminal equipment. The possibility of using multimedia servi
37、ces via 3G in a practical and reliable manner is extremely important in the near future. For these new services, it is certain that a much larger amount of traffic is generated between mobile terminals and services, i.e. traffic within 3G networks and between 3G networks and other networks will be h
38、igher than has been the case to date. This gives more importance to service quality requirements. End-to-end multimedia service performance metrics are proposed to make it possible for operators, device provider and service providers to more conveniently evaluate their service quality as perceived b
39、y end-users. This includes: Definition of the performance characteristics that have most relevance to end users (the Quality of Experience or QoE). Definition of the mapping between QoE and end-to-end service measured characteristics (the ESQoS), and mapping between ESQoS and service specific charac
40、teristics (the SQoS). In the present document a top-down approach is used to illustrate the framework of all metrics. The present document gives metrics of the end-to-end multimedia service performance on 3G networks that support PSS, PSC, video telephony, MBMS and IMS services, etc. QoE parameters
41、describe the end-to-end quality as experienced by the end users. These are difficult to measure and quantify. SQoS parameters are metrics that are close related to the network status, and defined from the viewpoint of the service provider rather than the service user. SQoS parameters can be viewed a
42、s the inherent attributes of the networks, which are important in guaranteeing QoE requirements of the users. ESQoS parameters describe the QoS of the end-to-end service. They are obtained directly from the QoE parameters by mapping them into parameters more relevant to operators, service providers
43、and service providers. ETSI ETSI TR 126 944 V13.0.0 (2016-01)83GPP TR 26.944 version 13.0.0 Release 13In Annex A, PSS is taken as an example; several general models looking at different part of network are given. A mapping between QoE, ESQoS and SQoS is given using a mathematical approach, which def
44、ines a dimensioned relationship between user experiences and lower tiers of network performance. ETSI ETSI TR 126 944 V13.0.0 (2016-01)93GPP TR 26.944 version 13.0.0 Release 131 Scope The present document describes and defines performance metrics for popular multimedia services in 3G networks, inclu
45、ding packed-switched streaming service (PSS), multimedia broadcast multicast service (MBMS), video telephony (VT), and IP multimedia subsystem service (IMS). The present document has a top-down approach, which starts with the Quality of Experience (QoE) parameters and metrics, and then provides End-
46、to-end Service QoS (ESQoS) and System Quality of Service (SQoS) parameters and metrics and mapping between these different layers. 2 References The following documents contain provisions which, through reference in this text, constitute provisions of the present document. References are either speci
47、fic (identified by date of publication, edition number, version number, etc.) or non-specific. For a specific reference, subsequent revisions do not apply. For a non-specific reference, the latest version applies. In the case of a reference to a 3GPP document (including a GSM document), a non-specif
48、ic reference implicitly refers to the latest version of that document in the same Release as the present document. 1 3GPP TS 23.107:“Technical Specification Group Services and System Aspects; Quality of Service (QoS) concept and architecture“. 2 3GPP TS 23.207:“Technical Specification Group Services
49、 and System Aspects; End-to-end Quality of Service (QoS) concept and architecture“. 3 ETSI TS 102 250-2 V1.4.1 (2006-03): “Speech Processing, Transmission and Quality Aspects (STQ);QoS aspects for popular services in GSM and 3G networks; Part 2: Definition of Quality of Service parameters and their computation“. 4 IETF RFC 2679: “A One-way Delay Metric for IPPM“. 5 IETF RFC 3133: “Terminology for Frame Relay Benchmarking“. 6 ITU-R Recommendation BS.1387-1: “Method for objective measurements of perceived audio quality“. 7 3GPP TS 26.234: “Technical Sp