ETSI TR 126 952-2018 Universal Mobile Telecommunications System (UMTS) LTE Codec for Enhanced Voice Services (EVS) Performance characterization (V15 0 0 3GPP TR 26 952 version 15 0.pdf

1、 ETSI TR 126 952 V15.0.0 (2018-07) Universal Mobile Telecommunications System (UMTS); LTE; Codec for Enhanced Voice Services (EVS); Performance characterization (3GPP TR 26.952 version 15.0.0 Release 15) TECHNICAL REPORT ETSI ETSI TR 126 952 V15.0.0 (2018-07)13GPP TR 26.952 version 15.0.0 Release 15

2、Reference RTR/TSGS-0426952vf00 Keywords LTE,UMTS ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notic

3、e The present document can be downloaded from: http:/www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorizat

4、ion of ETSI. In case of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aw

5、are that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at https:/portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comment to one of the following s

6、ervices: https:/portal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version

7、 shall not be modified without the written authorization of ETSI. The copyright and the foregoing restriction extend to reproduction in all media. ETSI 2018. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are trademarks of ETSI registered for the benefit of its Members. 3GPPTM and

8、 LTETMare trademarks of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. oneM2M logo is protected for the benefit of its Members. GSMand the GSM logo are trademarks registered and owned by the GSM Association. ETSI ETSI TR 126 952 V15.0.0 (2018-07)23GPP TR 26.9

9、52 version 15.0.0 Release 15Intellectual Property Rights Essential patents IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be

10、found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR

11、 Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Trademarks Th

12、e present document may include trademarks and/or tradenames which are asserted and/or registered by their owners. ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no right to use or reproduce any trademark and/or tradename. Mention of th

13、ose trademarks in the present document does not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks. Foreword This Technical Report (TR) has been produced by ETSI 3rd Generation Partnership Project (3GPP). The present document may refer to techni

14、cal specifications or reports using their 3GPP identities, UMTS identities or GSM identities. These should be interpreted as being references to the corresponding ETSI deliverables. The cross reference between GSM, UMTS, 3GPP and ETSI identities can be found under http:/webapp.etsi.org/key/queryform

15、.asp. Modal verbs terminology In the present document “should“, “should not“, “may“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed i

16、n ETSI deliverables except when used in direct citation. ETSI ETSI TR 126 952 V15.0.0 (2018-07)33GPP TR 26.952 version 15.0.0 Release 15Contents Intellectual Property Rights 2g3Foreword . 2g3Modal verbs terminology 2g3Foreword . 6g31 Scope 7g32 References 7g33 Abbreviations . 8g34 General . 9g34.1 P

17、roject History 9g34.2 Overview of the EVS Codec Work Item 10g34.3 Presentation of the Following clauses 11g35 Terms of Reference 11g36 Selection Process 12g37 Introduction to the Testing of the EVS codec 13g37.0 General methodology . 13g37.1 EVS Selection Phase Testing . 13g37.2 EVS Characterization

18、 Phase Testing 16g38 Important Notes about the Interpretation of Test Results 16g39 EVS Performance in Narrowband 17g39.1 NB Selection Tests . 17g39.1.1 Experiment N1 18g39.1.2 Experiment N2 19g39.1.3 Experiment N3 21g39.1.4 Experiment N4 21g39.2 NB Characterization Tests 23g39.2.0 List of experimen

19、ts in the narrowband telephone bandwidth . 23g39.2.1 Experiment N1 23g39.2.2 Experiment N2 25g39.2.3 Experiment N3 25g39.2.4 Experiment N4 27g39.3 Conclusions on EVS Performance in Narrowband 28g310 EVS Performance in Wideband . 28g310.1 WB Selection Tests 28g310.1.1 Experiment W1 . 29g310.1.2 Exper

20、iment W2 . 30g310.1.3 Experiment W3 . 31g310.1.4 Experiment W4 . 31g310.1.5 Experiment W5 . 32g310.1.6 Experiment W6 . 32g310.1.7 Experiment W7 . 33g310.1.8 Experiment I1 . 34g310.1.9 Experiment I2 . 34g310.1.10 Experiment I3 . 35g310.1.11 Experiment I4 . 36g310.1.12 Experiment I5 . 36g310.1.13 Expe

21、riment I6 . 37g310.2 WB Characterization Tests . 38g310.2.0 List of experiments in the wideband frequency bandwidth 38g310.2.1 Experiment W1 . 38g310.2.2 Experiment W2 . 39g3ETSI ETSI TR 126 952 V15.0.0 (2018-07)43GPP TR 26.952 version 15.0.0 Release 1510.2.3 Experiment W3 . 41g310.2.4 Experiment W4

22、 . 43g310.2.5 Experiment W5 . 44g310.3 Conclusions on EVS Performance in Wideband 46g311 EVS Performance in Super-Wideband . 46g311.1 SWB Selection Tests 46g311.1.1 Experiment S1 47g311.1.2 Experiment S2 48g311.1.3 Experiment S3 49g311.1.4 Experiment S4 50g311.1.5 Experiment S5 51g311.1.6 Experiment

23、 S6 52g311.1.7 Experiment S7 53g311.2 SWB Characterization Tests. 54g311.2.0 List of experiments in the super-wideband frequency bandwidth 54g311.2.1 Experiment S1 55g311.2.2 Experiment S2 55g311.2.3 Experiment S3 57g311.2.4 Experiment S1_Noisy . 58g311.3 Conclusions on EVS Performance in Super-Wide

24、band . 59g312 Mixed Bandwidth and Fullband Tests in Characterization 59g312.1 Mixed Bandwidth Tests 59g312.1.1 Experiment M1 . 60g312.1.2 Experiment M2 . 61g312.1.3 Experiment M3 . 62g312.2 Fullband Tests 64g312.2.0 List of experiments in the fullband frequency bandwidth. 64g312.2.1 Experiment F1 64

25、g312.2.2 Experiment F2 65g313 Objective Evaluations. 66g313.1 Selection Phase . 66g313.1.1 Objective Measurements . 66g313.1.2 Verification of Codec Performance with respect to Acoustic Test Cases based on the EVS Selection Phase Executable 67g313.1.2.1 Evaluation Setup . 67g313.1.2.2 General 68g313

26、.1.2.3 EVS-Mode: Narrowband (NB) - Frequency Response with Real Speech . 69g313.1.2.4 EVS-Mode: Wideband (WB) Frequency Response with Real Speech 69g313.1.2.5 EVS-Mode: Super-Wideband (SWB) Frequency Response with Real Speech 70g313.1.2.6 Conclusions . 71g313.2 Complexity and Delay Analysis . 71g313

27、.3 EVS JBM Objective Performance Evaluation in Channel Aware Mode 73g313.4 Frequency Response . 75g313.4.1 Evaluation of Codec Performance with respect to Acoustic Test Cases based on EVS v.12.1.0 7 75g313.4.1.1 Evaluation Setup . 75g313.4.1.2 General 75g313.4.1.3 EVS-Mode: Narrowband (NB) Frequency

28、 Response with Real Speech 76g313.4.1.4 EVS-Mode: Wideband (WB) Frequency Response with Real Speech 77g313.4.1.5 EVS-Mode: Super-Wideband (SWB) Frequency Response with Real Speech 79g313.4.1.6 EVS-Mode: Fullband (FB) Frequency Response with Real Speech 80g313.4.1.7 Conclusions . 81g313.5 Further Eva

29、luations 81g313.6 Conclusions on Objective Evaluations . 81g3Annex A: ToR Tests in Selection Phase . 82g3A.1 ToR Tests for Requirements. 82g3A.2 ToR Tests for Objectives 84g3A.3 ToR Tests by Sets . 85g3ETSI ETSI TR 126 952 V15.0.0 (2018-07)53GPP TR 26.952 version 15.0.0 Release 15A.4 Comparison of L

30、istening Labs . 86g3Annex B: Overall Characterization of the EVS Codec . 88g3Annex C: EVS Permanent Documents in 3GPP FTP-site 89g3Annex D: Attachments . 90g3Annex E: Change History . 91g3History 92g3ETSI ETSI TR 126 952 V15.0.0 (2018-07)63GPP TR 26.952 version 15.0.0 Release 15Foreword This Technic

31、al Report has been produced by the 3rdGeneration Partnership Project (3GPP). The contents of the present document are subject to continuing work within the TSG and may change following formal TSG approval. Should the TSG modify the contents of the present document, it will be re-released by the TSG

32、with an identifying change of release date and an increase in version number as follows: Version x.y.z where: x the first digit: 1 presented to TSG for information; 2 presented to TSG for approval; 3 or greater indicates TSG approved document under change control. y the second digit is incremented f

33、or all changes of substance, i.e. technical enhancements, corrections, updates, etc. z the third digit is incremented when editorial only changes have been incorporated in the document. ETSI ETSI TR 126 952 V15.0.0 (2018-07)73GPP TR 26.952 version 15.0.0 Release 151 Scope The present document provid

34、es information on the Enhanced Voice Services (EVS) codec Selection, Verification and Characterization Phases which were run using the fixed-point code (3GPP TS 26.442). Experimental test results from the subjective quality testing are reported to illustrate the behaviour of the EVS codec. Additiona

35、l information is provided on implementation complexity of the EVS codec and objective test results. Also the verification results for the floating-point version of the EVS codec (3GPP TS 26.443) are presented. 2 References The following documents contain provisions which, through reference in this t

36、ext, constitute provisions of the present document. - References are either specific (identified by date of publication, edition number, version number, etc.) or non-specific. - For a specific reference, subsequent revisions do not apply. - For a non-specific reference, the latest version applies. I

37、n the case of a reference to a 3GPP document (including a GSM document), a non-specific reference implicitly refers to the latest version of that document in the same Release as the present document. 1 3GPP TR 21.905: “Vocabulary for 3GPP Specifications“. 2 3GPP TS 26.441: “Codec for Enhanced Voice

38、Services (EVS); General overview“. 3 3GPP TS 26.442: “Codec for Enhanced Voice Services (EVS); ANSI C code (fixed-point)“. 4 3GPP TS 26.443: “Codec for Enhanced Voice Services (EVS); ANSI C code (floating-point)“. 5 3GPP TS 26.444: “Codec for Enhanced Voice Services (EVS); Test Sequences“. 6 3GPP TS

39、 26.445: “Codec for Enhanced Voice Services (EVS); Detailed algorithmic description“. 7 3GPP TS 26.446: “Codec for Enhanced Voice Services (EVS); Adaptive Multi-Rate - Wideband (AMR-WB) backward compatible functions“. 8 3GPP TS 26.447: “Codec for Enhanced Voice Services (EVS); Error concealment of l

40、ost packets“. 9 3GPP TS 26.448: “Codec for Enhanced Voice Services (EVS); Jitter buffer management“. 10 3GPP TS 26.449: “Codec for Enhanced Voice Services (EVS); Comfort Noise Generation (CNG) aspects“. 11 3GPP TS 26.450: “Codec for Enhanced Voice Services (EVS); Discontinuous Transmission (DTX)“. 1

41、2 3GPP TS 26.451: “Codec for Enhanced Voice Services (EVS); Voice Activity Detection (VAD)“. 13 3GPP TS 26.114: “IP Multimedia Subsystem (IMS); Multimedia telephony; Media handling and interaction“. 14 3GPP TS 26.131: “Terminal acoustic characteristics for telephony; Requirements“. 15 3GPP SP-100202

42、: “EVS Work Item Description“. 16 3GPP TR 22.813: “Study of use cases and requirements for enhanced voice codecs for the Evolved Packet System (EPS) “. 17 EVS-3 Permanent Document: “EVS Performance Requirements“. 18 EVS-4 Permanent Document: “EVS Design Constraints“. 19 EVS-5b Permanent Document: “E

43、VS Selection Rules“. ETSI ETSI TR 126 952 V15.0.0 (2018-07)83GPP TR 26.952 version 15.0.0 Release 1520 EVS-6b Permanent Document: “EVS Selection Deliverables“. 21 EVS-7b Permanent Document: “Processing Plan for the EVS Selection Phase“. 22 EVS-8b Permanent Document: “Test Plan for the EVS Selection

44、Phase“. 23 EVS-7c Permanent Document: Processing Plan for the EVS Characterization Phase 24 EVS-8c Permanent Document: “Test Plan for the EVS Characterization Phase“. 25 Recommendation ITU-T P.800: “Methods for subjective determination of transmission quality“. 26 3GPP TR 22.105: “Services and servi

45、ce capabilities“. 27 Recommendation ITU-T G.191: “Software tools for speech and audio coding standardization“, 03/2010, electronic attachment: STL2009 Software Tool Library. 28 Recommendation ITU-T G.100.1: “The use of the decibel and of relative levels in speechband telecommunications“, 11/2001. 29

46、 3GPP TS 26.132: “Speech and video telephony terminal acoustic test specification (Release 12)“. 30 Recommendation ITU-T P.501: “Test signals for use in telephonometry“, 01/2012. 3 Abbreviations For the purposes of the present document, the abbreviations given in 3GPP TR 21.905 1 and the following a

47、pply. An abbreviation defined in the present document takes precedence over the definition of the same abbreviation, if any, in 3GPP TR 21.905 1. ACELP Algebraic Code-Excited Linear Prediction ACR Absolute Category Rating AMR Adaptive Multi-RateAMR-WB Adaptive Multi-Rate Wideband CCR Comparison Cate

48、gory RatingCI Confidence IntervalCMOS Comparison MOS CNG Comfort Noise Generation CS Circuit Switched CuT Codec under Test DCR Degradation Category Rating DMOS Differential MOS DS Direct Source DTMF Dual Tone Multi Frequency DTX Discontinuous Transmission EDGE Enhanced Data rates for GSM Evolution E

49、FR Enhanced Full-Rate ETSI European Telecommunication Standards Institute EVS Enhanced Voice Services FB Fullband FEC Frame Erasure Concealment FER Frame Erasure FR Full-Rate GAL Global Analysis Laboratory GERAN GSM/EDGE Radio Access Network GSM Global System for Mobile communications HD High DefinitionHR Half-Rate IO InteroperableITU-T International Telecommunication Union Telecommunications Standardisation Sector IP Internet Protocol JICO Jitter Induced Concealment Operation JBM Jitter Buffer M