1、 ETSI TS 103 189 V1.2.1 (2014-04) Core Network and Interoperability Testing (INT); Assessment of end-to-end Quality for VoLTE and RCS floppy3Technical Specification ETSI ETSI TS 103 189 V1.2.1 (2014-04)2Reference RTS/INT-00101 Keywords assessment, QoS, video, voice ETSI 650 Route des Lucioles F-0692
2、1 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present document can be downloaded from: http:/www.etsi.org The present docum
3、ent may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference in contents between such versions and/o
4、r in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current sta
5、tus of this and other ETSI documents is available at http:/portal.etsi.org/tb/status/status.asp If you find errors in the present document, please send your comment to one of the following services: http:/portal.etsi.org/chaircor/ETSI_support.asp Copyright Notification No part may be reproduced or u
6、tilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be modified without the written authorization of ETSI. The copyright and the foregoing restriction extend t
7、o reproduction in all media. European Telecommunications Standards Institute 2014. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are Trade Marks of ETSI registered for the benefit of its Members and
8、 of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI TS 103 189 V1.2.1 (2014-04)3Contents Intellectual Property Rights 5g3Foreword . 5g3Introduction 5g31 Scope 6g32 References 6g32.1 Normative references . 6g32.2 Informativ
9、e references 8g33 Abbreviations . 8g34 The general structure of assessment of end-to-end Quality for VoLTE and RCS . 9g34.1 Tests cases described in TS 186 011-2 . 11g34.1.1 User-initiated VoIP call setup and release (TS 186 011-2, clause 4.4.2) 11g34.1.2 Addition of media stream (TS 186 011-2, clau
10、se 4.4.11) . 12g34.1.3 Ad-hoc Conferencing service (TS 186 011-2, clause 4.4.13) . 12g34.1.4 IPTV service (TS 186 011-2, clause 4.4.14) . 13g34.1.5 IMS-to-PSTN call (TS 186 011-2, clause 4.4.16.1) 14g34.1.6 PSTN-to-IMS call (TS 186 011-2, clause 4.4.16.2) 15g34.2 Tests cases described in TS 102 901
11、16g34.2.1 TD_IMS_SHARE_0001 (TS 102 901, clause 4.5.4.1.1) 16g34.2.2 TD_IMS_SHARE_0002 (TS 102 901, clause 4.5.4.1.2) 16g34.3 Tests and test sessions 16g34.4 Test Reports 17g35 Test overview . 17g35.1 General Test Description 17g35.2 End-to-end Tests based on Instrumental Assessment of Speech Sample
12、s 18g35.3 End-to-end Tests based on Instrumental Assessment of Video Samples . 18g35.4 Other end-to-end tests in the voice channel 19g35.5 End-to-end Tests based on functional parameters 20g35.5.1 Voice Service 20g35.5.1.1 Telephony Call Setup Time. 20g35.5.2 Video Streaming Service 20g35.5.2.1 Stre
13、aming Service Access Time 20g35.6 Network Performance Parameters 21g35.7 Future extension of the tests . 21g36 Detailed Test Description . 22g36.1 QoS_Voice_el_qualification: End-to-end Quality assessment of voice service 23g36.1.1 End-to-end Speech Quality assessment 23g36.1.1.1 QoS_Voice_ac_01: Te
14、sting at Acoustical Interfaces . 23g36.1.1.1.1 Measurement setup 24g36.1.1.1.2 Measurement methodology . 25g36.1.1.1.3 Test signals 25g36.1.1.1.4 Instrumental assessment of listening quality . 26g36.1.1.2 QoS_Voice_ac_el_01: Testing from an Acoustical to an Electrical Interface 26g36.1.1.2.1 Measure
15、ment setup 27g36.1.1.2.2 Measurement methodology . 28g36.1.1.2.3 Test signals 28g36.1.1.2.4 Instrumental assessment of listening quality . 29g36.1.1.3 QoS_Voice_el_ac_01: Testing from an Electrical to an Acoustical Interface 29g36.1.1.3.1 Measurement setup 30g36.1.1.3.2 Measurement methodology . 31g
16、36.1.1.3.3 Test signals 31g36.1.1.3.4 Instrumental assessment of listening quality . 32g36.1.1.4 QoS_Voice_el_01: Testing at Electrical Interfaces 33g3ETSI ETSI TS 103 189 V1.2.1 (2014-04)46.1.1.4.1 Measurement setup 33g36.1.1.4.2 Measurement methodology . 33g36.1.1.4.3 Test signals 34g36.1.1.4.4 In
17、strumental assessment of listening quality . 34g36.1.2 Other end-to-end tests in the voice channel 35g36.1.2.1 Testing at Acoustical Interfaces 35g36.1.2.1.1 Measurement setup 35g36.1.2.1.2 Measurement methodology . 36g36.1.2.1.3 Test signals 41g36.1.2.2 Testing from an Acoustical to an Electrical I
18、nterface . 41g36.1.2.2.1 Measurement setup 41g36.1.2.2.2 Measurement methodology . 42g36.1.2.2.3 Test signals 48g36.1.2.3 Testing from an Electrical to an Acoustical Interface . 48g36.1.2.3.1 Measurement setup 48g36.1.2.3.2 Measurement methodology . 49g36.1.2.3.3 Test signals 54g36.1.2.4 Testing at
19、Electrical Interfaces 55g36.1.2.4.1 Measurement setup 55g36.1.2.4.2 Measurement methodology . 55g36.1.2.4.3 Test signals 56g36.1.3 QoS_Voice_func_01: Functional Quality parameters of the voice channel . 56g36.1.4 QoS_Voice_np_01: Network performance parameters in the voice channel . 56g36.2 End-to-e
20、nd Quality assessment of video service 57g36.2.1 End-to-end Video Quality assessment 57g36.2.1.1 Testing at Optical Interfaces . 57g36.2.1.2 QoS_Video_filebased_01: Testing with inserted and retrieved video files 57g36.2.1.2.1 Measurement setup 58g36.2.1.2.2 Measurement methodology . 58g36.2.1.2.3 T
21、est signals 59g36.2.1.2.4 Instrumental assessment of video quality 59g36.2.2 Other end-to-end tests in the video channel 59g36.2.3 QoS_Video_func_01: Functional Quality parameters of the video channel 59g36.2.4 QoS_Video_np_01: Network performance parameters in the video channel 60g37 Documentation
22、and Interpretation of Test Results . 60g37.1 Measurement configuration description . 61g37.1.1 Mandatory documentation of test results 61g37.2 One-view visualization of performances 61g37.2.1 Creation of Quality Pies according to Recommendation ITU-T P.505 61g37.3 Visualization of performance variat
23、ions . 63g37.4 Result interpretations 64g3Annex A (normative): Mandatory template for result reporting 65g3Annex B (informative): Level Adjustment for Headset Interfaces 66g3Annex C (informative): Conclusions from Validation of the present document 67g3History 69g3ETSI ETSI TS 103 189 V1.2.1 (2014-0
24、4)5Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Prope
25、rty Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (http:/ipr.etsi.org). Pursuant to the ETSI IPR Policy, no investigation, including IPR search
26、es, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Foreword This Technical Specification (TS) has been produced
27、 by ETSI Technical Committee Core Network and Interoperability Testing (INT). The present document contains a new annex C with conclusions from the validation carried out 18-20 November 2013 at ETSI premises. Introduction VoLTE and RCS Interop Events are initiatives of the industry, brought into ope
28、ration by ETSI TC INT and other partner organizations. The consideration of end-to-end quality of service (as perceived by the user) will play a key role in the successful deployment of VoLTE and RCS. Therefore, ETSI TC INT has decided to enrich the world of LTE testing by the inclusion of speech an
29、d video quality components. The present document constitutes a starting point on this new way forward and other services and aspects are to be considered based on feedback from real testing. With the present document ETSI TC INT establishes a connection between the world of formal testing and the en
30、d-to-end quality aspects as perceived by the user - thus providing valuable feedback to network operators and service providers on network performance aspects. ETSI ETSI TS 103 189 V1.2.1 (2014-04)61 Scope The present document specifies a set of end-to-end speech and video quality test extensions to
31、 TS 186 011-1 4, TS 102 901 2 and TS 103 029 3. In particular, it describes end-to-end tests based on instrumental assessment of speech samples, end-to-end tests based on instrumental assessment of video samples, other end-to-end tests in the voice channel, end-to-end tests based on functional param
32、eters and tests monitoring network performance parameters. In addition to that, a future extension of the tests is described in the present document. To some extent the end-to-end speech and video quality tests are self-contained and are therefore provided as a self-standing document. NOTE 1: It is
33、worth noting that 80 % of the test cases described in the present document have been validated during a dedicated validation event carried out 18-20 November 2013 at ETSI premises (see annex C for more details). NOTE 2: The tests specified in the present document may be found useful for end-to-end s
34、peech and video quality testing outside the context of VoLTE and RCS. 2 References References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the lat
35、est version of the referenced document (including any amendments) applies. Referenced documents which are not found to be publicly available in the expected location might be found at http:/docbox.etsi.org/Reference. NOTE: While any hyperlinks included in this clause were valid at the time of public
36、ation, ETSI cannot guarantee their long term validity. 2.1 Normative references The following referenced documents are necessary for the application of the present document. 1 ETSI ES 201 168: “Speech Processing, Transmission and Quality Aspects (STQ); Transmission characteristics of digital Private
37、 Branch eXchanges (PBXs) for interconnection to private networks, to the public switched network or to IP gateways“. 2 ETSI TS 102 901 (V.5.1.1): “Core Network and Interoperability Testing (INT); IMS NNI Interoperability Test Specifications; IMS NNI interoperability test descriptions for RCS (3GPP R
38、elease 10)“. 3 ETSI TS 103 029: “IMS Network Testing (INT); IMS IMS NNI Interoperability Test Specifications (3GPP Release 10); Part 1: Test purposes for IMS NNI Interoperability“. 5 ETSI TS 186 011-2 (V5.1.1): “Core Network and Interoperability Testing (INT); IMS NNI Interoperability Test Specifica
39、tions (3GPP Release 10); Part 2: Test descriptions for IMS NNI Interoperability“. 6 ISO 3 (1973): “Preferred numbers - Series of preferred numbers“. 7 Recommendation ITU-T J.247: “Objective perceptual multimedia video quality measurement in the presence of a full reference“. 8 Recommendation ITU-T P
40、.50: “Artificial voices“. 9 Recommendation ITU-T P.57: “Artificial ears“. ETSI ETSI TS 103 189 V1.2.1 (2014-04)710 Recommendation ITU-T P.58: “Head and torso simulator for telephonometry“. 11 Recommendation ITU-T P.64: “Determination of sensitivity/frequency characteristics of local telephone system
41、s“. 12 Recommendation ITU-T P.79: “Calculation of loudness ratings for telephone sets“. 13 Recommendation ITU-T P.340: “Transmission characteristics and speech quality parameters of hands-free terminals“. 14 Recommendation ITU-T P.380: “Electro-acoustic measurements on headsets“. 15 Recommendation I
42、TU-T P.501: “Test signals for use in telephonometry“. 16 Recommendation ITU-T P.505: “One-view visualization of speech quality measurement results“. 17 Recommendation ITU-T P.502: “Objective test methods for speech communication systems using complex test signals“. 18 Recommendation ITU-T P.581: “Us
43、e of head and torso simulator (HATS) for hands-free terminal testing“. 19 Recommendation ITU-T P.800.1: “Mean Opinion Score (MOS) terminology“. 20 Recommendation ITU-T P.863: “Perceptual objective listening quality assessment“. 21 Moorthy, A.K.; Lark Kwon Choi; Bovik, A.C.; de Veciana, G.: “Video Qu
44、ality Assessment on Mobile Devices: Subjective, Behavioural and Objective Studies“, In IEEE Journal of Selected Topics in Signal Processing, vol. 6, No. 6, October 2012, pp. 652-671, ISSN 1932-4553. 22 Seshadrinathan, K.; Soundararajan, R.; Bovik, A.C.; Cormack, L.K.: “Study of Subjective and Object
45、ive Quality Assessment of Video, In IEEE Transactions on Image Processing“, vol. 19, No. 6, June 2010, pp. 1427-1440, ISSN 1057-7149. 23 Chikkerur, S.; Sundaram, V.; Reisslein, M.; Karam, L.J.: “Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison“, In IEE
46、E Transactions on Broadcasting, vol.57, No.2, June 2011, pp. 165-182, ISSN 0018-9316. 24 Hekstra, A.P.; Beerends, J.G.; Ledermann, D.; de Caluwe, F.E.; Kohler, S.; Koenen, R.H.; Rihs, S.; Ehrsam, M.; Schlauss, D.: “PVQM-A perceptual video quality measure, In Signal Processing: Image Communication“,
47、vol. 17, No.10, pp. 781-798, Nov. 2002, ISSN 0923-5965. 25 Final report from the video quality experts group on the validation of objective models of multimedia quality assessment, Phase 1, Video Quality Experts Group (VQEG), 2008. 26 Recommendation ITU-T Y.1541 (12-2011): “Network performance objec
48、tives for IP-based services“. 27 IETF RFC 3357 (2002): “ One-way Loss Pattern Sample Metrics“. 28 ETSI TS 103 106: “Speech and multimedia Transmission Quality (STQ);Speech quality performance in the presence of background noise: Background noise transmission for mobile terminals-objective test metho
49、ds“. 29 Recommendation ITU-T P.1110: “Wideband hands-free communication in motor vehicles“. 30 Recommendation ITU-T P.56: “Objective measurement of active speech level“. 31 Recommendation ITU-T P.863.1: “Application guide for Recommendation ITU-T P.863“. ETSI ETSI TS 103 189 V1.2.1 (2014-04)82.2 Informative references The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area. i.1 ETSI
