ETSI TS 103 222-3-2015 Speech and multimedia Transmission Quality (STQ) Reference benchmarking background traffic profiles and KPIs Part 3 Reference benchmarking background traffic_1.pdf

1、 ETSI TS 103 222-3 V1.1.1 (2015-12) Speech and multimedia Transmission Quality (STQ); Reference benchmarking, background traffic profiles and KPIs; Part 3: Reference benchmarking, background traffic profiles and KPIs for UMTS and VoLTE TECHNICAL SPECIFICATION ETSI ETSI TS 103 222-3 V1.1.1 (2015-12)2

2、 Reference DTS/STQ-219-3 Keywords KPI, QoS ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The

3、present document can be downloaded from: http:/www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of

4、 ETSI. In case of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware th

5、at the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at http:/portal.etsi.org/tb/status/status.asp If you find errors in the present document, please send your comment to one of the following services: https:/

6、portal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be mo

7、dified without the written authorization of ETSI. The copyright and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2015. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Trade Marks of ETSI registered for the benefi

8、t of its Members. 3GPPTM and LTE are Trade Marks of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI TS 103 222-3 V1.1.1 (2015-12)3 Contents Intellectual Property Rights

9、 4g3Foreword . 4g3Modal verbs terminology 4g3Introduction 4g31 Scope 5g32 References 5g32.1 Normative references . 5g32.2 Informative references 6g33 Definitions and abbreviations . 6g33.1 Definitions 6g33.2 Abbreviations . 6g34 Management Summary. 7g34.1 Introduction 7g34.2 Scope of functionality 7

10、g35 Technical concept . 8g35.1 Introduction 8g35.2 Network side measurements in mobile networks . 8g35.3 Call set-up delay . 8g35.4 Telephony Setup Time . 9g35.5 Listening speech quality . 10g35.5.1 General aspects of Listening Speech Quality 10g35.5.2 General aspects of voice channel test calls . 1

11、0g35.5.3 Connections without parallel data transfer 10g35.5.3.1 Connections with one voice channel . 10g35.5.3.2 Multiple voice channel access . 12g35.5.4 Connections with parallel data transfer . 12g35.5.4.1 Connections with one voice channel and parallel data transfer . 12g35.5.4.2 Parallel qualit

12、y measurement of one voice channel and data transmission speed . 13g35.5.4.3 Quality measurement of multiple voice channels and data transfer 13g35.5.4.4 Parallel quality measurement of multiple voice channels and data transmission speed 13g36 Broadband Speed Test (BST) - Measurement method of data

13、transmission speed and transit time 14g36.1 Introduction 14g3History 15g3ETSI ETSI TS 103 222-3 V1.1.1 (2015-12)4 Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, i

14、s publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on th

15、e ETSI Web server (http:/ipr.etsi.org). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETS No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, o

16、r may become, essential to the present document. Foreword This Technical Specification (TS) has been produced by ETSI Technical Committee Speech and multimedia Transmission Quality (STQ). The present document is part 3 of a multi-part deliverable covering then Reference benchmarking, background traf

17、fic profiles and KPIs as identified below: Part 1: “Reference benchmarking, background traffic profiles and KPIs for VoIP and FoIP in fixed networks“; Part 2: “Reference benchmarking and KPIs for High speed internet“; Part 3: “Reference benchmarking, background traffic profiles and KPIs for UMTS and

18、 VoLTE“; Part 4: “Reference benchmarking for IPTV, Web TV and RCS-e Video Share“. Modal verbs terminology In the present document “shall“, “shall not“, “should“, “should not“, “may“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Draft

19、ing Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in direct citation. Introduction The present document describes the reference benchmarking, background traffic profiles and key performance Indicators for UMTS and V

20、oLTE. ETSI ETSI TS 103 222-3 V1.1.1 (2015-12)5 1 Scope The offer of new NGN services requires new: KPIs; QoS measurement; and benchmarking methods which are needed to ensure the quality of new services. To ensure the comparability of test results, reference benchmarking methods and background traffi

21、c load profiles are needed. The present document: identifies and defines possible key performance indicators for voice and fax telephony services; defines benchmarking methods for the spectrum of potential applications. The scope of the defined testing procedures is the evaluation of the network acc

22、ess by VoIP and FoIP for mobile -network services. The measurements are conducted between a mobile device to a measurement point which can be a mobile device or a device emulating an idealized termination point in the core network. All access technologies offered by the operator under test are consi

23、dered. In this context the measurements and key performance indicators determinations are performed by analysing signals accessible on the network. The present document is not intended to overlap with the scope of the series ETSI TS 102 250 i.3. Measurements described in that series are not affected

24、 by the provisions of the present document. The present document contains possible KPIs for UMTS and VoLTE as well as framework requirements for reference benchmarking particularly with regard to background traffic profiles. 2 References 2.1 Normative references References are either specific (ident

25、ified by date of publication and/or edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the reference document (including any amendments) applies. Referenced documents which are not found to be

26、 publicly available in the expected location might be found at http:/docbox.etsi.org/Reference. NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee their long term validity. The following referenced documents are necessary for the applicati

27、on of the present document. 1 Recommendation ITU-T E.800 (2008): “Definitions of terms related to quality of service“. 2 ETSI TS 102 250-2 (V2.3.1): “Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in mobile networks; Part 2: Definition of Quality of Service parame

28、ters and their computation“. 3 ETSI TS 101 563 (V1.3.1): “Speech and multimedia Transmission Quality (STQ); IMS/PES/VoLTE exchange performance requirements“. 4 Recommendation ITU-T Q.543 (1993): “Digital exchange performance design objectives“. 5 ETSI TS 103 222-1: “Speech and multimedia Transmissio

29、n Quality (STQ); Reference benchmarking, background traffic profiles and KPIs; Part 1: Reference benchmarking, background traffic profiles and KPIs for VoIP and FoIP in fixed networks“. ETSI ETSI TS 103 222-3 V1.1.1 (2015-12)6 6 ETSI TBR 003 ed.1 (11-1995): “Integrated Services Digital Network (ISDN

30、); Attachment requirements for terminal equipment to connect to an ISDN using ISDN basic access“. 7 ETSI TBR 004 ed.1 (11-1995): “Integrated Services Digital Network (ISDN); Attachment requirements for terminal equipment to connect to an ISDN using ISDN primary rate access“. 2.2 Informative referenc

31、es References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the reference document (including any amendments) applies. NOTE:

32、While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee their long term validity. The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area. i.1

33、ETSI EG 202 425 (V1.1.1): “Speech Processing, Transmission and Quality Aspects (STQ); Definition and implementation of VoIP reference point“. i.2 ETSI EG 202 057-2: “Speech and multimedia Transmission Quality (STQ); User related QoS parameter definitions and measurements; Part 2: Voice telephony, Gr

34、oup 3 fax, modem data services and SMS“. i.3 ETSI TS 102 250 (all parts): “Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in mobile networks“. 3 Definitions and abbreviations 3.1 Definitions For the purposes of the present document, the following terms and definit

35、ions apply: benchmark: evaluation of performance value/s of a parameter or set of parameters for the purpose of establishing value/s as the norm against which future performance achievements may be compared or assessed NOTE: The definition is taken from Recommendation ITU-T E.800 1. 3.2 Abbreviation

36、s For the purposes of the present document, the following abbreviations apply: AGCF Access Gateway Control Function BRI Basic Rate Interface BST Broadband Speed TestCCCH Common Control Channel CS Circuit Switched CSFB Circuit Switched Fall Back DTMF Dual-Tone Multi-Frequency signalling EG ETSI Guide

37、 EPS Evolved Packet System ESM EPS Session Management GSM Global System for Mobile communications HTTP Hypertext Transfer Protocol IMS Internet Multimedia Subsystem IP Internet Protocol ISDN Integrated Services Digital Network ITU-T Telecommunication Standardization Sector of the International Telec

38、ommunications Union KPI Key Performance Indicator LTE Long Term Evolution MMTel Multimedia Telephony service ETSI ETSI TS 103 222-3 V1.1.1 (2015-12)7 NGN New Generation Network PES PSTN Emulation Subsystem PRI Primary Rate Interface PSTN Public Switched Telephone Network RACH Random Access Channel R

39、RC Radio Resource Control SIP Session Initiation Protocol TV Television UMTS Universal Mobile Telecommunications System VGW Voice GateWay VoIP Voice over IP VoLTE Voice over LTE 4 Management Summary 4.1 Introduction The spectrum of potential applications of a benchmarking platform requires measureme

40、nts including but not limited to the following: analogue (a/b), ISDN, VoIP (including SIP trunking), high-speed internet, UMTS and VoLTE. The performance data which are collected will be relevant for a real-world environment encompassing a mix of technologies. This approach ensures that service qual

41、ity is evaluated from a customers point of view, since all system components involved in an end-to-end connection are incorporated into the test. 4.2 Scope of functionality A benchmarking platform can be distributed across a larger region or an entire country. In this case several server systems sho

42、uld be also part of the setup, including: a business intelligence platform; a data warehouse, a management system and a system for evaluating of media (e.g. video, audio and voice) quality. The measurement systems at the user premises are connected electrically to VoLTE and UMTS. The test system (Qo

43、S control and data server) is connected through UMTS, LTE or ISDN connections (via IMS PES with AGCF (or PSTN or ISDN Access) or IMS PES with VGW) or MMTel (IMS) fixed access lines for voice quality measurements. Figure 1: Setup of the benchmarking platform ETSI ETSI TS 103 222-3 V1.1.1 (2015-12)8 5

44、 Technical concept 5.1 Introduction The conduction of voice quality measurements is following the guidelines given in ETSI EG 202 057-2 i.2, Recommendation ITU-T Q.543 4, ETSI TS 101 563 3 and ETSI TS 102 250-2 2. 5.2 Network side measurements in mobile networks The conduction of voice quality measu

45、rements is following the descriptions that can be found in ETSI EG 202 057-2 i.2, Recommendation ITU-T Q.543 4, ETSI TS 101 563 3 and ETSI TS 102 250-2 2, clauses 6.6.3.1 and 6.6.3.2. The access points of the test equipment which are used for inserting or retrieving the signals needed for determinin

46、g the speech quality parameters shall conform to the reference characteristics as laid down in the following relevant standards: ETSI EG 202 425 i.1 for VoIP access; ETSI TBR 003 6 for analogue access and ISDN BRI access; ETSI TBR 004 7 for ISDN PRI access. The following KPI values are recorded as p

47、art of the voice quality measurements. Table 1: Overview of Quality characteristics for voice quality measurements Overview of quality benchmarking for voice quality measurements 1. call set-up delay 4 and session initiation call set-up delay 3, see clause 5.2 2. call set-up time (Post Dialling Dela

48、y) 5, see clause 5.3 3. Premature release probability (Call Failure Rate), see clause 5.4 in 5 4. Telephony Cut-off Call Ratio % (Call drop rate), see clause 5.5 in 5 5. Media establishment delay, see clause 5.6 in 5 6. Level of active speech signal, see clause 5.7 in 5 7. Noise level, see clause 5.

49、8 in 5 8. Signal to Noise ratio, see clause 5.9 in 5 9. Speech signal attenuation, see clause 5.10 in 5 10. Talker echo delay, see clause 5.11 in 5 11. Double talk, see clause 5.12 in 5 12. Interrupted voice transmission, see clause 5.13 in 5 13. Listening speech quality, see clause 5.4 14. Listening speech quality stability, see clause 5.15 in 5 15. End-to-end audio delay, see clause 5.16 in 5 16. End-to-end audio delay variation, see clause 5.17 in 5 17. Frequency response, see