1、 ETSI TR 1Digital cellular telecoUniversal Mobile TelPacket Switched (PS) coPerformance cha(3GPP TR 26.9TECHNICAL REPORT 126 935 V13.0.0 (2016communications system (Phaelecommunications System (LTE; conversational multimedia apharacterisation of default cod.935 version 13.0.0 Release 1316-01) hase 2
2、+); (UMTS); applications; odecs 13) ETSI ETSI TR 126 935 V13.0.0 (2016-01)13GPP TR 26.935 version 13.0.0 Release 13Reference RTR/TSGS-0426935vd00 Keywords GSM,LTE,UMTS ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 5
3、62 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present document can be downloaded from: http:/www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of
4、any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Fo
5、rmat (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at http:/portal.etsi.org/tb/sta
6、tus/status.asp If you find errors in the present document, please send your comment to one of the following services: https:/portal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including
7、photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be modified without the written authorization of ETSI. The copyright and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Instit
8、ute 2016. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are Trade Marks of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Mark
9、s registered and owned by the GSM Association. ETSI ETSI TR 126 935 V13.0.0 (2016-01)23GPP TR 26.935 version 13.0.0 Release 13Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPR
10、s, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are ava
11、ilable on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which a
12、re, or may be, or may become, essential to the present document. Foreword This Technical Report (TR) has been produced by ETSI 3rd Generation Partnership Project (3GPP). The present document may refer to technical specifications or reports using their 3GPP identities, UMTS identities or GSM identiti
13、es. These should be interpreted as being references to the corresponding ETSI deliverables. The cross reference between GSM, UMTS, 3GPP and ETSI identities can be found under http:/webapp.etsi.org/key/queryform.asp. Modal verbs terminology In the present document “shall“, “shall not“, “should“, “sho
14、uld not“, “may“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in direct citation. ETSI ETSI T
15、R 126 935 V13.0.0 (2016-01)33GPP TR 26.935 version 13.0.0 Release 13Contents Intellectual Property Rights 2g3Foreword . 2g3Modal verbs terminology 2g3Foreword . 6g31 Scope 7g32 References 7g33 Abbreviations . 8g33.1 Abbreviations . 8g34 General Overview. 9g34.1 Introduction 9g34.2 Tests over DCH rad
16、io channels 9g34.3 Tests over HSDPA/EUL radio channels 10g35 Test bed and test plan for Phase 1 10g35.1 Test methodology . 11g35.2 Test arrangement 11g35.2.1 Description of the testing system 11g35.2.2 Network simulator 12g35.2.3 UMTS simulator choices 13g35.2.3.1 RAB and protocols 13g35.2.3.2 Descr
17、iption of the RLC implementation . 14g35.2.3.3 Physical Layer Implementation . 15g35.2.4 Headsets and Sound Card . 17g35.2.5 Test environment 17g35.2.6 Calibration and test conditions monitoring . 17g35.2.6.1 Speech level 17g35.2.6.2 Delay. 17g35.3 Test conditions for AMR-NB codec . 18g35.4 Test con
18、ditions for AMR-WB codec 19g36 Test bed and test plan for Phase 2 20g36.1 Test arrangement 21g36.1.1 Description of the proposed testing system 21g36.1.2 Network simulator 22g36.1.3 Calibration and test conditions monitoring . 22g36.2 Test Conditions 23g37 Analysis of test results for DCH channels f
19、or Phase 1 and 2 . 23g37.1 Conversation Tests . 23g37.2 Experimental Design and Statistical Procedures 24g37.3 Narrowband Test - Symmetric conditions (Set 1) 25g37.4 Narrowband Test Asymmetric Conditions (Set 2) . 31g37.5 Wideband Test Symmetric Conditions (Set 3) 33g37.6 Wideband Test Asymmetric Co
20、nditions (Set 4) 38g37.7 Phase 2 - ITU-T Codec Tests (Set 5) 41g37.8 Summary of Test Result Analysis 44g38 Performance characterisation of VoIMS over HSDPA/EUL channels 44g38.A Listening only tests . 44g38.A.1 Test methodology for listening only tests . 44g38.A.2 Test arrangement 44g38.A.3 Jitter bu
21、ffer implementations 45g38.A.3.1 Fixed JBM . 45g38.A.3.2 Adaptive JBM . 45g3ETSI ETSI TR 126 935 V13.0.0 (2016-01)43GPP TR 26.935 version 13.0.0 Release 138.A.4 Network conditions . 45g38.A.5 Listening experiments . 46g38.A.6 Test Results . 47g38.A.7 Delay analysis . 52g38.A.8 Listening only test co
22、nclusions 58g38.B Conversation Tests . 58g38.B.1 Introduction. 58g38.B.2 The Test Plan 58g38.B.3 Cross-check of Test Lab Results . 60g38.B.4 Test Results . 60g38.B.4.1 Mean Scores by Experiment and by Test Lab . 60g38.B.4.2 Subject Consistency Measures for Test Labs 64g38.B.4.3 Multivariate Analysis
23、 of Variance (MANOVA) . 64g38.B.4.3.1 MANOVA Results and Statistics 65g38.B.4.3.2 Composite Scores Conversational Quality . 67g38.B.4.3.3 Conversational Quality by Experimental Factors 69g38.B.5 Conversation tests conclusions . 73g39 Conclusions 73g39.1 Tests over DCH radio channels 73g39.2 Tests ov
24、er HSDPA/EUL radio channels; listening only tests . 73g39.3 Tests over HSDPA/EUL radio channels; conversation tests 73g39.4 General consideration . 73g3Annex A: Conversation test composite dependent variable scores by condition and Lab 74g3Annex B: Instructions to subjects . 76g3Annex C: Example Sce
25、narios for the conversation test 77g3Annex D: Test Plan for the AMR Narrow-Band Packet Switched Conversation Test 79g3Annex E: Test Plan for the AMR Wide-Band Packet Switched Conversation Test 96g3Annex F: Test plan for Packet Switched Conversation Tests for Comparison of Quality Offered by Differen
26、t Speech Coders . 113g3Annex G: Test Plan for Global Analysis of PSS Conversation Tests. 125g3Annex H: Test Plan for Performance characterisation of VoIMS over HSDPA/EUL channels; listening only tests . 131g3H.1 Introduction 131g3H.2 Listening only test conditions. 131g3H.3 End-to-end delay analysis
27、 132g3H.4 Listening only experiments 132g3H.5 Test material processing . 133g3Annex I: Illustrative scheme for jitter buffer management 135g3I.1 Pseudo code 135g3I.2 Verification against the minimum performance requirements . 140g3I.2.1 Delay performance . 141g3I.2.2 JBM induced error concealment op
28、erations . 144g3Annex J: Test processing for listening only tests 145g3J.1 Speech preparation . 145g3J.2 Pre-processing 145g3J.3 Processing of speech/background noise signal . 145g3ETSI ETSI TR 126 935 V13.0.0 (2016-01)53GPP TR 26.935 version 13.0.0 Release 13J.4 Up and Down-Sampling, Rounding and S
29、caling . 146g3J.5 Processing for Direct Conditions . 147g3J.6 Processing for MNRU conditions 147g3J.7 Processing of voice over IMS over HSPA . 147g3J.8 Post-processing . 148g3J.9 Test conditions . 148g3Annex K: Radio network simulation for HSDPA/EUL performance characterization 151g3Annex L: Test Pl
30、an for the AMR NB/WB Conversation Test in UMTS over HSDPA/EUL 155g3L.1 Introduction 155g3L.2 General Information . 155g3L.2.1 Permanent Documents 155g3L.2.2 Key Acronyms 155g3L.2.3 Contacts 156g3L.2.4 Participants . 156g3L.3 Test Methodology 157g3L.3.1 Introduction 157g3L.3.2 Test Design . 158g3L.3.
31、2.1 Description of the Test Bed 158g3L.3.2.2 Transmission System 159g3L.3.2.3 Radio Access Bearers . 159g3L.3.2.4 Test environment 160g3L.3.3 Test Conditions 160g3L.4 Test Procedure 165g3L.4.1 Time Projection 165g3L.4.2 Instructions to the Subjects . 166g3L.4.3 Test Materials . 167g3L.4.4 Deliverabl
32、es 168g3L.4.5 Data Analysis . 168g3L.5 Working Document for the Performance Characterization of VoIMS over HSDPA/EDCH. 168g3L.5.1 Introduction 168g3L.5.2 System Overview . 168g3L.5.3 Radio Access Bearers . 170g3L.5.4 Delay 173g3L.5.5 RN Simulator 174g3L.5.6 Core Network . 175g3L.5.7 VoIP Client . 17
33、5g3L.5.8 Interfaces 177g3L.5.8.1 Interface 1 . 178g3L.5.8.2 Interface 2 . 178g3L.5.8.3 Interface 3 . 179g3L.5.9 Simulated HSPA Air-Interface . 179g3L.5.9.1 General Description 179g3L.5.9.2 Error-Delay Profiles . 180g3L.5.A.1 Network Parameters 183g3L.5.A.2 Traffic Assumptions (example: AMR 7.95) 184
34、g3L.5.A.3 Other Assumptions 185g3L.5.A.4 Simulation Methodology . 186g3Bibliography . 186g3Annex M: Change history 187g3History 188g3ETSI ETSI TR 126 935 V13.0.0 (2016-01)63GPP TR 26.935 version 13.0.0 Release 13Foreword This Technical Report has been produced by the 3rdGeneration Partnership Projec
35、t (3GPP). The contents of the present document are subject to continuing work within the TSG and may change following formal TSG approval. Should the TSG modify the contents of the present document, it will be re-released by the TSG with an identifying change of release date and an increase in versi
36、on number as follows: Version x.y.z where: x the first digit: 1 presented to TSG for information; 2 presented to TSG for approval; 3 or greater indicates TSG approved document under change control. y the second digit is incremented for all changes of substance, i.e. technical enhancements, correctio
37、ns, updates, etc. z the third digit is incremented when editorial only changes have been incorporated in the document. ETSI ETSI TR 126 935 V13.0.0 (2016-01)73GPP TR 26.935 version 13.0.0 Release 131 Scope The present document provides information on the performances of default speech codecs in pack
38、et switched conversational multimedia applications. The codecs under test are AMR-NB (Adaptive Multi-Rate Narrowband) and AMR-WB (Adaptive Multi-Rate Wideband). In addition, several ITU-T codecs (G.723.1, G.729, G.722 and G.711) are included in the testing. Experimental test results from the speech
39、quality testing are reported to illustrate the behaviour of these codecs. The results give information of the performance of PS conversational multimedia applications under various operating and transmission conditions (e.g., considering radio transmission errors, IP packet losses, end-to-end delays
40、, and several types of background noise). The performance results can be used e.g. as guidance for network planning and to appropriately adjust the radio network parameters. 2 References The following documents contain provisions which, through reference in this text, constitute provisions of the pr
41、esent document. References are either specific (identified by date of publication, edition number, version number, etc.) or non-specific. For a specific reference, subsequent revisions do not apply. For a non-specific reference, the latest version applies. In the case of a reference to a 3GPP docume
42、nt (including a GSM document), a non-specific reference implicitly refers to the latest version of that document in the same Release as the present document 1 ITU-T Recommendation P.800: “Methods for Subjective Determination of Transmission Quality“. 2 ITU-T Recommendation P.831: “Subjective perform
43、ance evaluation of network echo cancellers“. 3 ITU-T Recommendation G.711: “Pulse code modulation (PCM) of voice frequencies“. 4 ITU-T Recommendation G.729: “Coding of speech at 8 kbit/s using conjugate-structure algebraic-code-excited linear-prediction (CS-ACELP)“. 5 ITU-T Recommendation G.723.1: “
44、Dual rate speech coder for multimedia communications transmitting at 5.3 and 6.3 kbit/s“. 6 ITU-T Recommendation G.722: “7 kHz audio-coding within 64 kbit/s“. 7 IETF RFC 1889: “RTP: A Transport Protocol for Real-Time Applications“. 8 IETF RFC 3267: “Real-Time Transport Protocol (RTP) Payload Format
45、and File Storage Format for the Adaptive Multi-Rate (AMR) Adaptive Multi-Rate Wideband (AMR-WB) Audio Codecs“. 9 3GPP TS 34.121: “Terminal Conformance Specification, Radio Transmission and Reception (FDD)“ (downlink). 10 3GPP TS 25.141: “ Base Station (BS) conformance testing (FDD)“ (uplink). 11 3GP
46、P TR 25.853 “Delay budget within the access stratum“. 12 3GPP TS 26.235: “Packet switched conversational multimedia applications; Default codecs“. 13 3GPP TS 26.071: “AMR speech Codec; General description“. 14 3GPP TS 26.171: “AMR speech codec, wideband; General description“. 15 3GPP TS 25.322: “Rad
47、io Link Control (RLC) protocol specification“. 16 IETF RFC 3095: “RObust Header Compression (ROHC): Framework and four profiles: RTP, UDP, ESP, and uncompressed“. ETSI ETSI TR 126 935 V13.0.0 (2016-01)83GPP TR 26.935 version 13.0.0 Release 1317 3GPP TS 34.108: “Common test environments for User Equi
48、pment (UE) conformance testing“. 18 ETSI TR 101 112: “Universal Mobile Telecommunications System (UMTS); Selection procedures for the choice of radio transmission technologies of the UMTS“ (UMTS 30.03 v3.1.0). 19 3GPP TS 26.114 : IP Multimedia Subsystem (IMS); Multimedia Telephony; Media handling an
49、d interaction 20 ITU-T Recommendation P.805 (P.CONV): Subjective evaluation of conversational quality 3 Abbreviations 3.1 Abbreviations For the purposes of the present document, the following abbreviations apply: AMR-NB (or AMR) Adaptive Multi-Rate Narrowband Speech Codec AMR-WB Adaptive Multi-Rate Wideband Speech Codec ANOVA Analysis of Variance ASY ASYmmetric conditionsBLER Block Error Rate CDF Cumulative Distribution Function CMR Codec Mode Request COND Test CONDitionsCN Core NetworkCQ nversational Quality CRC Cycli
