1、 ETSI TR 126 944 V15.0.0 (2018-07) Universal Mobile Telecommunications System (UMTS); LTE; End-to-end multimedia services performance metrics (3GPP TR 26.944 version 15.0.0 Release 15) TECHNICAL REPORT ETSI ETSI TR 126 944 V15.0.0 (2018-07)13GPP TR 26.944 version 15.0.0 Release 15Reference RTR/TSGS-
2、0426944vf00 Keywords LTE,UMTS ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present docum
3、ent can be downloaded from: http:/www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In cas
4、e of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the docume
5、nt may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at https:/portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comment to one of the following services: https:/por
6、tal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be modif
7、ied without the written authorization of ETSI. The copyright and the foregoing restriction extend to reproduction in all media. ETSI 2018. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are trademarks of ETSI registered for the benefit of its Members. 3GPPTM and LTETMare trademark
8、s of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. oneM2M logo is protected for the benefit of its Members. GSMand the GSM logo are trademarks registered and owned by the GSM Association. ETSI ETSI TR 126 944 V15.0.0 (2018-07)23GPP TR 26.944 version 15.0.0 R
9、elease 15Intellectual Property Rights Essential patents IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR 00
10、0 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR Policy, no investi
11、gation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Trademarks The present document
12、may include trademarks and/or tradenames which are asserted and/or registered by their owners. ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no right to use or reproduce any trademark and/or tradename. Mention of those trademarks in t
13、he present document does not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks. Foreword This Technical Report (TR) has been produced by ETSI 3rd Generation Partnership Project (3GPP). The present document may refer to technical specifications
14、or reports using their 3GPP identities, UMTS identities or GSM identities. These should be interpreted as being references to the corresponding ETSI deliverables. The cross reference between GSM, UMTS, 3GPP and ETSI identities can be found under http:/webapp.etsi.org/key/queryform.asp. Modal verbs t
15、erminology In the present document “should“, “should not“, “may“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables
16、 except when used in direct citation. ETSI ETSI TR 126 944 V15.0.0 (2018-07)33GPP TR 26.944 version 15.0.0 Release 15Contents Intellectual Property Rights 2g3Foreword . 2g3Modal verbs terminology 2g3Foreword . 6g3Introduction 6g31 Scope 8g32 References 8g33 Abbreviations . 8g34 General description a
17、nd approach 9g34.1 Definitions . 9g34.2 QoE parameters . 10g34.3 ESQoS parameters . 11g34.4 SQoS parameters . 11g35 QoE parameters 13g35.1 General 13g35.2 Service non-access 13g35.3 Service failure . 13g35.4 Service setting-up time 13g35.5 Re-buffering 13g35.6 Image corruption . 13g35.7 Edge noise .
18、 13g35.8 Blurriness 13g35.9 Colour reproduction accuracy . 13g35.10 Blockiness . 14g35.11 Incontinuous image with block . 14g35.12 Freeze image . 14g35.13 Audio quality . 14g35.14 Audio/Video synchronization error . 14g36 ESQoS parameters 14g36.1 General 14g36.2 Service non-availability . 14g36.2.1
19、Abstract definition . 14g36.2.2 Equation . 15g36.2.3 Trigger point 15g36.3 Service failure ratio . 15g36.3.1 Abstract definition . 15g36.3.2 Equation . 15g36.3.3 Trigger point 15g36.4 Initial connection time . 16g36.4.1 Abstract definition . 16g36.4.2 Equation . 16g36.4.3 Trigger Point 16g36.5 Initi
20、al buffering time . 16g36.5.1 Abstract definition . 16g36.5.2 Equation . 16g36.5.3 Trigger Point 16g36.6 Re-buffering frequency . 16g36.6.1 Abstract definition . 16g36.6.2 Equation . 16g36.6.3 Trigger point 17g36.7 Re-buffering time 17g36.7.1 Abstract definition . 17g3ETSI ETSI TR 126 944 V15.0.0 (2
21、018-07)43GPP TR 26.944 version 15.0.0 Release 156.7.2 Equation . 17g36.7.3 Trigger point 17g36.8 Audio quality . 17g36.8.1 Abstract definition . 17g36.8.2 Equation . 17g36.8.3 Trigger point 17g36.9 Intra-frame video quality . 17g36.9.1 Abstract definition . 17g36.9.2 Equation . 18g36.9.3 Trigger poi
22、nt 18g36.10 Inter-frame video quality . 18g36.10.1 Abstract definition . 18g36.10.2 Equation . 18g36.10.3 Trigger point 18g36.11 Audio/Video de-synchronization error 18g36.11.1 Abstract definition . 18g36.11.2 Equation . 19g36.11.3 Trigger point 19g37 SQoS parameters 19g37.1 SQoS parameters of each
23、layer 19g37.1.1 Application 19g37.1.1.1 Frame rate 19g37.1.1.2 Frame loss ratio 19g37.1.1.3 Frame error ratio 19g37.1.1.4 Transaction rate 19g37.1.1.5 Transaction delay . 19g37.1.2 Transport 19g37.1.2.1 Bandwidth 19g37.1.2.2 Transfer delay 19g37.1.2.3 Jitter 20g37.1.2.4 Packet loss ratio . 20g37.1.2
24、.5 Packet error ratio 20g37.1.3 Sub-transport 20g37.1.3.1 Frame loss ratio 20g37.1.3.2 Residual frame error ratio 20g37.1.3.3 Frame discard ratio . 20g37.1.3.4 Residual bit ratio 20g37.1.3.5 Access delay . 20g37.1.3.6 Block ratio 20g37.1.3.7 Soft handoff rate . 20g37.2 SQoS parameters of each class
25、20g37.3 SQoS parameters of each service 21g38 Mapping between ESQoS and SQoS . 22g38.1 General 22g38.2 PSS 24g38.3 MBMS . 25g38.4 Video telephony 26g38.5 IMS 26g3Annex A: PSS Performance Analysis with Theoretical Models . 30g3A.1 Introduction 30g3A.2 Scope 30g3A.3 References 30g3A.4 General models .
26、 30g3A.4.1 Radio access network model . 31g3A.4.1.1 Model description 31g3A.4.1.2 The block ratio of new calls and the failure ratio of handoff calls . 31g3A.4.2 Transport network model 33g3ETSI ETSI TR 126 944 V15.0.0 (2018-07)53GPP TR 26.944 version 15.0.0 Release 15A.4.2.1 Model description 33g3A
27、.4.2.2 The mean transfer delay and the transfer time . 34g3A.4.3 Node model . 34g3A.4.3.1 Simple node model 34g3A.4.3.1.1 Model description 34g3A.4.3.1.2 The transaction delay and the data loss ratio 34g3A.4.3.2 Complex node model . 35g3A.4.3.2.1 Model description 35g3A.4.3.2.2 The transaction delay
28、 . 37g3A.5 Modelling the relationship between ESQoS and SQoS . 37g3A.5.1 Service Non-Availability . 37g3A.5.1.1 Relative SQoS and other parameters . 37g3A.5.1.2 Model description 39g3A.5.2 Service Failure Ratio . 41g3A.5.2.1 Relative SQoS and other parameters . 41g3A.5.2.2 Model description 42g3A.5.
29、3 Initial Connection Time . 44g3A.5.3.1 Relative SQoS and other parameters . 44g3A.5.3.2 Model description 45g3A.5.4 Initial Buffering Time . 47g3A.5.4.1 Relative SQoS and other parameters . 47g3A.5.4.2 Model description 48g3A.5.5 Re-Buffering Frequency 50g3A.5.5.1 Relative SQoS and other parameters
30、 . 50g3A.5.5.2 Model description 50g3A.5.6 Re-Buffering Time 51g3A.5.6.1 Relative SQoS and other parameters . 51g3A.5.6.2 Model description 51g3Annex B: Analysis of QoE . 52g3B.1 Introduction 52g3B.2 Process 52g3B.2.1 Collection of QoE 52g3B.2.2 Weightiness of Selected QoE 52g3B.3 Results 52g3B.3.1
31、Collection of QoE 52g3B.3.2 Comparison of Weightiness among Selected QoE Parameters . 53g3Annex C: Comparison with TS 102 250 of ETSI STQ Mobile . 54g3C.1 Introduction 54g3C.2 References 54g3C.3 Comparison with 3GPP E2EMSPM and ETSI STQ Mobile . 55g3C.3.1 Research Scope . 55g3C.3.1.1 Framework . 55g
32、3C.3.1.2 Quality of experience . 55g3C.3.1.3 End-to-End Service Quality of Service 56g3C.3.1.4 System Quality of Service . 56g3C.3.1.5 Mapping of End-to-End Service QoS and System QoS . 57g3C.3.2 Research Method . 57g3C.3.2.1 Statistics Model Analysis . 57g3C.3.2.2 Theory Model Analysis of Queue 57g
33、3C.3.2.3 Possible Further Work . 58g3C.4 Brief Introduction of the Work in ETSI STQ . 58g3Annex D: Change history 59g3History 60 ETSI ETSI TR 126 944 V15.0.0 (2018-07)63GPP TR 26.944 version 15.0.0 Release 15Foreword This Technical Report has been produced by the 3GPP. The contents of the present do
34、cument are subject to continuing work within the TSG and may change following formal TSG approval. Should the TSG modify the contents of the present document, it will be re-released by the TSG with an identifying change of release date and an increase in version number as follows: Version 3.y.z wher
35、e: x the first digit: 1 presented to TSG for information; 2 presented to TSG for approval; 3 Indicates TSG approved document under change control. y the second digit is incremented for all changes of substance, i.e. technical enhancements, corrections, updates, etc. z the third digit is incremented
36、when editorial only changes have been incorporated in the specification; Introduction The Quality of Experience (QoE), End-to-end Service Quality of Service (ESQoS) and System Quality of Service (SQoS) are important factors when introducing services to customers. When the next releases of 3G are lau
37、nched to the mass market, several new mobile telecommunication multimedia services will be introduced to the general public. It is essential that a high quality if service is experienced by the user of these new 3G services in order to promote the idea of 3G as a global all-purpose communication too
38、l for millions of people with widespread availability of terminal equipment. The possibility of using multimedia services via 3G in a practical and reliable manner is extremely important in the near future. For these new services, it is certain that a much larger amount of traffic is generated betwe
39、en mobile terminals and services, i.e. traffic within 3G networks and between 3G networks and other networks will be higher than has been the case to date. This gives more importance to service quality requirements. End-to-end multimedia service performance metrics are proposed to make it possible f
40、or operators, device provider and service providers to more conveniently evaluate their service quality as perceived by end-users. This includes: - Definition of the performance characteristics that have most relevance to end users (the Quality of Experience or QoE). - Definition of the mapping betw
41、een QoE and end-to-end service measured characteristics (the ESQoS), and mapping between ESQoS and service specific characteristics (the SQoS). In the present document a top-down approach is used to illustrate the framework of all metrics. The present document gives metrics of the end-to-end multime
42、dia service performance on 3G networks that support PSS, PSC, video telephony, MBMS and IMS services, etc. QoE parameters describe the end-to-end quality as experienced by the end users. These are difficult to measure and quantify. SQoS parameters are metrics that are close related to the network st
43、atus, and defined from the viewpoint of the service provider rather than the service user. SQoS parameters can be viewed as the inherent attributes of the networks, which are important in guaranteeing QoE requirements of the users. ESQoS parameters describe the QoS of the end-to-end service. They ar
44、e obtained directly from the QoE parameters by mapping them into parameters more relevant to operators, service providers and service providers. ETSI ETSI TR 126 944 V15.0.0 (2018-07)73GPP TR 26.944 version 15.0.0 Release 15In Annex A, PSS is taken as an example; several general models looking at di
45、fferent part of network are given. A mapping between QoE, ESQoS and SQoS is given using a mathematical approach, which defines a dimensioned relationship between user experiences and lower tiers of network performance. ETSI ETSI TR 126 944 V15.0.0 (2018-07)83GPP TR 26.944 version 15.0.0 Release 151
46、Scope The present document describes and defines performance metrics for popular multimedia services in 3G networks, including packed-switched streaming service (PSS), multimedia broadcast multicast service (MBMS), video telephony (VT), and IP multimedia subsystem service (IMS). The present document
47、 has a top-down approach, which starts with the Quality of Experience (QoE) parameters and metrics, and then provides End-to-end Service QoS (ESQoS) and System Quality of Service (SQoS) parameters and metrics and mapping between these different layers. 2 References The following documents contain pr
48、ovisions which, through reference in this text, constitute provisions of the present document. - References are either specific (identified by date of publication, edition number, version number, etc.) or non-specific. - For a specific reference, subsequent revisions do not apply. - For a non-specif
49、ic reference, the latest version applies. In the case of a reference to a 3GPP document (including a GSM document), a non-specific reference implicitly refers to the latest version of that document in the same Release as the present document. 1 3GPP TS 23.107:“Technical Specification Group Services and System Aspects; Quality of Service (QoS) concept and architecture“. 2 3GPP TS 23.207:“Technical Specification Group Services and System Aspects; End-to-end Quality of Service (QoS) concept and architecture“. 3 ETSI TS 102 250-2 V1.4.1 (2006-03): “Speech Processing, Trans
