1、 ETSI TR 126 944 V14.0.0 (2017-04) Universal Mobile Telecommunications System (UMTS); LTE; End-to-end multimedia services performance metrics (3GPP TR 26.944 version 14.0.0 Release 14) TECHNICAL REPORT ETSI ETSI TR 126 944 V14.0.0 (2017-04)13GPP TR 26.944 version 14.0.0 Release 14Reference RTR/TSGS-
2、0426944ve00 Keywords LTE,UMTS ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present docum
3、ent can be downloaded from: http:/www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In cas
4、e of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the docume
5、nt may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at https:/portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comment to one of the following services: https:/por
6、tal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be modif
7、ied without the written authorization of ETSI. The copyright and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2017. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Trade Marks of ETSI registered for the benefit o
8、f its Members. 3GPPTM and LTE are Trade Marks of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI TR 126 944 V14.0.0 (2017-04)23GPP TR 26.944 version 14.0.0 Release 14In
9、tellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Property R
10、ights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches,
11、 has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Foreword This Technical Report (TR) has been produced by ETSI 3
12、rd Generation Partnership Project (3GPP). The present document may refer to technical specifications or reports using their 3GPP identities, UMTS identities or GSM identities. These should be interpreted as being references to the corresponding ETSI deliverables. The cross reference between GSM, UMT
13、S, 3GPP and ETSI identities can be found under http:/webapp.etsi.org/key/queryform.asp. Modal verbs terminology In the present document “should“, “should not“, “may“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verba
14、l forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in direct citation. ETSI ETSI TR 126 944 V14.0.0 (2017-04)33GPP TR 26.944 version 14.0.0 Release 14Contents Intellectual Property Rights 2g3Foreword . 2g3Modal verbs terminology 2g3
15、Foreword . 6g3Introduction 6g31 Scope 8g32 References 8g33 Abbreviations . 8g34 General description and approach 9g34.1 Definitions . 9g34.2 QoE parameters . 10g34.3 ESQoS parameters . 11g34.4 SQoS parameters . 11g35 QoE parameters 13g35.1 General 13g35.2 Service non-access 13g35.3 Service failure .
16、 13g35.4 Service setting-up time 13g35.5 Re-buffering 13g35.6 Image corruption . 13g35.7 Edge noise . 13g35.8 Blurriness 14g35.9 Colour reproduction accuracy . 14g35.10 Blockiness . 14g35.11 Incontinuous image with block . 14g35.12 Freeze image . 14g35.13 Audio quality . 14g35.14 Audio/Video synchro
17、nization error . 14g36 ESQoS parameters 14g36.1 General 14g36.2 Service non-availability . 15g36.2.1 Abstract definition . 15g36.2.2 Equation . 15g36.2.3 Trigger point 15g36.3 Service failure ratio . 15g36.3.1 Abstract definition . 15g36.3.2 Equation . 15g36.3.3 Trigger point 16g36.4 Initial connect
18、ion time . 16g36.4.1 Abstract definition . 16g36.4.2 Equation . 16g36.4.3 Trigger Point 16g36.5 Initial buffering time . 16g36.5.1 Abstract definition . 16g36.5.2 Equation . 16g36.5.3 Trigger Point 17g36.6 Re-buffering frequency . 17g36.6.1 Abstract definition . 17g36.6.2 Equation . 17g36.6.3 Trigge
19、r point 17g36.7 Re-buffering time 17g36.7.1 Abstract definition . 17g3ETSI ETSI TR 126 944 V14.0.0 (2017-04)43GPP TR 26.944 version 14.0.0 Release 146.7.2 Equation . 17g36.7.3 Trigger point 17g36.8 Audio quality . 18g36.8.1 Abstract definition . 18g36.8.2 Equation . 18g36.8.3 Trigger point 18g36.9 I
20、ntra-frame video quality . 18g36.9.1 Abstract definition . 18g36.9.2 Equation . 18g36.9.3 Trigger point 18g36.10 Inter-frame video quality . 19g36.10.1 Abstract definition . 19g36.10.2 Equation . 19g36.10.3 Trigger point 19g36.11 Audio/Video de-synchronization error 19g36.11.1 Abstract definition .
21、19g36.11.2 Equation . 19g36.11.3 Trigger point 19g37 SQoS parameters 20g37.1 SQoS parameters of each layer 20g37.1.1 Application 20g37.1.1.1 Frame rate 20g37.1.1.2 Frame loss ratio 20g37.1.1.3 Frame error ratio 20g37.1.1.4 Transaction rate 20g37.1.1.5 Transaction delay . 20g37.1.2 Transport 20g37.1.
22、2.1 Bandwidth 20g37.1.2.2 Transfer delay 20g37.1.2.3 Jitter 20g37.1.2.4 Packet loss ratio . 20g37.1.2.5 Packet error ratio 21g37.1.3 Sub-transport 21g37.1.3.1 Frame loss ratio 21g37.1.3.2 Residual frame error ratio 21g37.1.3.3 Frame discard ratio . 21g37.1.3.4 Residual bit ratio 21g37.1.3.5 Access d
23、elay . 21g37.1.3.6 Block ratio 21g37.1.3.7 Soft handoff rate . 21g37.2 SQoS parameters of each class 21g37.3 SQoS parameters of each service 22g38 Mapping between ESQoS and SQoS . 23g38.1 General 23g38.2 PSS 25g38.3 MBMS . 26g38.4 Video telephony 27g38.5 IMS 27g3Annex A: PSS Performance Analysis wit
24、h Theoretical Models . 31g3A.1 Introduction 31g3A.2 Scope 31g3A.3 References 31g3A.4 General models . 32g3A.4.1 Radio access network model . 32g3A.4.1.1 Model description 32g3A.4.1.2 The block ratio of new calls and the failure ratio of handoff calls . 33g3A.4.2 Transport network model 34g3ETSI ETSI
25、 TR 126 944 V14.0.0 (2017-04)53GPP TR 26.944 version 14.0.0 Release 14A.4.2.1 Model description 34g3A.4.2.2 The mean transfer delay and the transfer time . 35g3A.4.3 Node model . 35g3A.4.3.1 Simple node model 35g3A.4.3.1.1 Model description 35g3A.4.3.1.2 The transaction delay and the data loss ratio
26、 36g3A.4.3.2 Complex node model . 36g3A.4.3.2.1 Model description 36g3A.4.3.2.2 The transaction delay . 38g3A.5 Modelling the relationship between ESQoS and SQoS . 39g3A.5.1 Service Non-Availability . 39g3A.5.1.1 Relative SQoS and other parameters . 39g3A.5.1.2 Model description 40g3A.5.2 Service Fa
27、ilure Ratio . 42g3A.5.2.1 Relative SQoS and other parameters . 42g3A.5.2.2 Model description 43g3A.5.3 Initial Connection Time . 45g3A.5.3.1 Relative SQoS and other parameters . 45g3A.5.3.2 Model description 46g3A.5.4 Initial Buffering Time . 48g3A.5.4.1 Relative SQoS and other parameters . 48g3A.5.
28、4.2 Model description 49g3A.5.5 Re-Buffering Frequency 51g3A.5.5.1 Relative SQoS and other parameters . 51g3A.5.5.2 Model description 51g3A.5.6 Re-Buffering Time 52g3A.5.6.1 Relative SQoS and other parameters . 52g3A.5.6.2 Model description 52g3Annex B: Analysis of QoE . 53g3B.1 Introduction 53g3B.2
29、 Process 53g3B.2.1 Collection of QoE 53g3B.2.2 Weightiness of Selected QoE 53g3B.3 Results 53g3B.3.1 Collection of QoE 53g3B.3.2 Comparison of Weightiness among Selected QoE Parameters . 54g3Annex C: Comparison with TS 102 250 of ETSI STQ Mobile . 55g3C.1 Introduction 55g3C.2 References 55g3C.3 Comp
30、arison with 3GPP E2EMSPM and ETSI STQ Mobile . 56g3C.3.1 Research Scope . 56g3C.3.1.1 Framework . 56g3C.3.1.2 Quality of experience . 56g3C.3.1.3 End-to-End Service Quality of Service 57g3C.3.1.4 System Quality of Service . 57g3C.3.1.5 Mapping of End-to-End Service QoS and System QoS . 58g3C.3.2 Res
31、earch Method . 58g3C.3.2.1 Statistics Model Analysis . 58g3C.3.2.2 Theory Model Analysis of Queue 59g3C.3.2.3 Possible Further Work . 59g3C.4 Brief Introduction of the Work in ETSI STQ . 59g3Annex D: Change history 60g3History 61 ETSI ETSI TR 126 944 V14.0.0 (2017-04)63GPP TR 26.944 version 14.0.0 R
32、elease 14Foreword This Technical Report has been produced by the 3GPP. The contents of the present document are subject to continuing work within the TSG and may change following formal TSG approval. Should the TSG modify the contents of the present document, it will be re-released by the TSG with a
33、n identifying change of release date and an increase in version number as follows: Version 3.y.z where: x the first digit: 1 presented to TSG for information; 2 presented to TSG for approval; 3 Indicates TSG approved document under change control. y the second digit is incremented for all changes of
34、 substance, i.e. technical enhancements, corrections, updates, etc. z the third digit is incremented when editorial only changes have been incorporated in the specification; Introduction The Quality of Experience (QoE), End-to-end Service Quality of Service (ESQoS) and System Quality of Service (SQo
35、S) are important factors when introducing services to customers. When the next releases of 3G are launched to the mass market, several new mobile telecommunication multimedia services will be introduced to the general public. It is essential that a high quality if service is experienced by the user
36、of these new 3G services in order to promote the idea of 3G as a global all-purpose communication tool for millions of people with widespread availability of terminal equipment. The possibility of using multimedia services via 3G in a practical and reliable manner is extremely important in the near
37、future. For these new services, it is certain that a much larger amount of traffic is generated between mobile terminals and services, i.e. traffic within 3G networks and between 3G networks and other networks will be higher than has been the case to date. This gives more importance to service quali
38、ty requirements. End-to-end multimedia service performance metrics are proposed to make it possible for operators, device provider and service providers to more conveniently evaluate their service quality as perceived by end-users. This includes: Definition of the performance characteristics that ha
39、ve most relevance to end users (the Quality of Experience or QoE). Definition of the mapping between QoE and end-to-end service measured characteristics (the ESQoS), and mapping between ESQoS and service specific characteristics (the SQoS). In the present document a top-down approach is used to illu
40、strate the framework of all metrics. The present document gives metrics of the end-to-end multimedia service performance on 3G networks that support PSS, PSC, video telephony, MBMS and IMS services, etc. QoE parameters describe the end-to-end quality as experienced by the end users. These are diffic
41、ult to measure and quantify. SQoS parameters are metrics that are close related to the network status, and defined from the viewpoint of the service provider rather than the service user. SQoS parameters can be viewed as the inherent attributes of the networks, which are important in guaranteeing Qo
42、E requirements of the users. ESQoS parameters describe the QoS of the end-to-end service. They are obtained directly from the QoE parameters by mapping them into parameters more relevant to operators, service providers and service providers. ETSI ETSI TR 126 944 V14.0.0 (2017-04)73GPP TR 26.944 vers
43、ion 14.0.0 Release 14In Annex A, PSS is taken as an example; several general models looking at different part of network are given. A mapping between QoE, ESQoS and SQoS is given using a mathematical approach, which defines a dimensioned relationship between user experiences and lower tiers of netwo
44、rk performance. ETSI ETSI TR 126 944 V14.0.0 (2017-04)83GPP TR 26.944 version 14.0.0 Release 141 Scope The present document describes and defines performance metrics for popular multimedia services in 3G networks, including packed-switched streaming service (PSS), multimedia broadcast multicast serv
45、ice (MBMS), video telephony (VT), and IP multimedia subsystem service (IMS). The present document has a top-down approach, which starts with the Quality of Experience (QoE) parameters and metrics, and then provides End-to-end Service QoS (ESQoS) and System Quality of Service (SQoS) parameters and me
46、trics and mapping between these different layers. 2 References The following documents contain provisions which, through reference in this text, constitute provisions of the present document. References are either specific (identified by date of publication, edition number, version number, etc.) or
47、non-specific. For a specific reference, subsequent revisions do not apply. For a non-specific reference, the latest version applies. In the case of a reference to a 3GPP document (including a GSM document), a non-specific reference implicitly refers to the latest version of that document in the same
48、 Release as the present document. 1 3GPP TS 23.107:“Technical Specification Group Services and System Aspects; Quality of Service (QoS) concept and architecture“. 2 3GPP TS 23.207:“Technical Specification Group Services and System Aspects; End-to-end Quality of Service (QoS) concept and architecture
49、“. 3 ETSI TS 102 250-2 V1.4.1 (2006-03): “Speech Processing, Transmission and Quality Aspects (STQ);QoS aspects for popular services in GSM and 3G networks; Part 2: Definition of Quality of Service parameters and their computation“. 4 IETF RFC 2679: “A One-way Delay Metric for IPPM“. 5 IETF RFC 3133: “Terminology for Frame Relay Benchmarking“. 6 ITU-R Recommendation BS.1387-1: “Method for objective measurements of perceived audio quality“. 7 3GPP TS 26.234: “Technical Specification Group Services and System Aspects; Transparent end-to-end Packet-swit
