ETSI TR 146 055-2016 Digital cellular telecommunications system (Phase 2+) Performance characterization of the GSM Enhanced Full Rate (EFR) speech codec (V13 0 0 3GPP TR 46 055 ver.pdf

1、 ETSI TR 1Digital cellular telecoPerformance Enhanced Fu(3GPP TR 46.0TECHNICAL REPORT 146 055 V13.0.0 (2016communications system (Phae characterization of the GSMFull Rate (EFR) speech codec.055 version 13.0.0 Release 13GLOBAL SYSTEMOBILE COMMUN16-01) hase 2+); M ec 13) TEM FOR ICATIONSRETSI ETSI TR

2、 146 055 V13.0.0 (2016-01)13GPP TR 46.055 version 13.0.0 Release 13Reference RTR/TSGS-0446055vd00 Keywords GSM ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregis

3、tre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present document can be downloaded from: http:/www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present docum

4、ent shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive withi

5、n ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at http:/portal.etsi.org/tb/status/status.asp If you find errors in the present document

6、, please send your comment to one of the following services: https:/portal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by writte

7、n permission of ETSI. The content of the PDF version shall not be modified without the written authorization of ETSI. The copyright and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2016. All rights reserved. DECTTM, PLUGTESTSTM, UMTST

8、Mand the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are Trade Marks of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI

9、TR 146 055 V13.0.0 (2016-01)23GPP TR 46.055 version 13.0.0 Release 13Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non

10、-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pur

11、suant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present do

12、cument. Foreword This Technical Report (TR) has been produced by ETSI 3rd Generation Partnership Project (3GPP). The present document may refer to technical specifications or reports using their 3GPP identities, UMTS identities or GSM identities. These should be interpreted as being references to th

13、e corresponding ETSI deliverables. The cross reference between GSM, UMTS, 3GPP and ETSI identities can be found under http:/webapp.etsi.org/key/queryform.asp. Modal verbs terminology In the present document “shall“, “shall not“, “should“, “should not“, “may“, “need not“, “will“, “will not“, “can“ an

14、d “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in direct citation. ETSI ETSI TR 146 055 V13.0.0 (2016-01)33GPP TR 46.055 version 13.0.0

15、 Release 13Contents Intellectual Property Rights 2g3Foreword . 2g3Modal verbs terminology 2g3Foreword . 5g3Introduction 6g31 Scope 8g32 References 8g33 Abbreviations . 8g34 Quality under error (EP0 EP3) and tandeming conditions (Exp Number 1 and Exp Number 5) 9g35 Quality under background noise cond

16、itions (Exp Number 2 and Exp Number 3) . 10g36 Talker dependency (Exp Number 4) 10g37 DTX system 10g37.1 Channel activity in DTX mode . 10g37.1.1 Test procedure 10g37.1.2 Speech channel activity 10g37.1.3 Level compensation 10g37.1.4 Interleaving compensation 11g37.1.5 Estimated mean TDMA channel ac

17、tivity 11g37.2 DTX/CNI Informal Expert Listening tests . 11g37.2.1 Introduction. 11g37.2.2 Test environment 11g37.2.3 Results 11g38 Performance with DTMF tones 11g38.1 Introduction 11g38.2 Test environment 12g38.3 Results 12g39 Network information tones . 13g310 Performance with special input signal

18、s 13g310.1 Music signals 13g310.2 Noise signals 14g311 Performance with different languages 14g312 Delay 15g313 Frequency response 18g313.1 Introduction 18g313.2 Test environment 18g313.3 Results 18g314 Complexity . 19g315 Summary of the results from the subjective testing . 20g3Annex A: Summary of

19、results (lab by lab) 22g3A.1 Quality under Error and tandeming conditions 22g3A.2 Quality under Background noise conditions 24g3A.3 Quality for Talker Dependency (DMOS and SD) 25g3ETSI ETSI TR 146 055 V13.0.0 (2016-01)43GPP TR 46.055 version 13.0.0 Release 13Annex B: Change history 26g3History 27g3E

20、TSI ETSI TR 146 055 V13.0.0 (2016-01)53GPP TR 46.055 version 13.0.0 Release 13Foreword This Technical Specification has been produced by the 3rdGeneration Partnership Project (3GPP). The contents of the present document are subject to continuing work within the TSG and may change following formal TS

21、G approval. Should the TSG modify the contents of the present document, it will be re-released by the TSG with an identifying change of release date and an increase in version number as follows: Version x.y.z where: x the first digit: 1 presented to TSG for information; 2 presented to TSG for approv

22、al; 3 or greater indicates TSG approved document under change control. y the second digit is incremented for all changes of substance, i.e. technical enhancements, corrections, updates, etc. z the third digit is incremented when editorial only changes have been incorporated in the document. ETSI ETS

23、I TR 146 055 V13.0.0 (2016-01)63GPP TR 46.055 version 13.0.0 Release 13Introduction The SMG2-Speech experts Group (SEG) started its activity early in 1995 for the standardization of an Enhanced Full Rate speech codec. The Group produced a test plan for the first phase of testing (pre-selection phase

24、) which is described in permanent document SEG-4 (ETSI SMG2 SEG: SEG-4 (v 1.0) “A Subjective Pre-Selection Test Plan for the Enhanced Full Rate Speech Coding Algorithm“) to assess the performance of the submitted candidates. This test plan is based on the general knowledge coming from past ITU-T and

25、 ETSI activities on codec evaluation (GSM half rate and ITU-T 8 kbit/s recent exercises for instance). At the end of this Pre-selection Phase, SMG decided to standardize the PCS 1 900 codec, known as the US-1 codec and no formal characterisation testing has been performed for the selected codec. The

26、 present document therefore reports the results from the Pre-selection and Verification Phase of testing only. Consequently, the results reported here are less detailed, and the confidence intervals for them are wider, than those obtained for the GSM half rate standardization (GSM 06.08, 3) where sp

27、ecific and detailed characterisation testing was performed. In addition, not all laboratories followed the same pre-selection test plan, further complicating the interpretation of the results. The following experiments included in SEG-4 were carried out by several laboratories in the Pre-selection P

28、hase: - Experiment 1: Quality under error and tandeming conditions (A-law, Modified IRS); - Experiment 2: Quality under background noise conditions (Vehicular noise, UPCM, NoIRS); - Experiment 3: Quality under background noise conditions (Background music, UPCM, NoIRS); - Experiment 4: Talker Depend

29、ency (UPCM, NoIRS); - Experiment 5: Quality under high error conditions EP3 (A-law, Modified IRS). A practical indirect method of performance comparison between different results was adopted utilising the Modulated Noise Reference Unit (MNRU) (see note) as a reference degradation. The MNRU provides

30、the additional function of allowing normalisation of results across different laboratories carrying out the same experiment, through the conversion of MOS scores to Equivalent Q (dB). The Q (dB) values introduced in a test normally range from 0 to 50 dB. In SEG-4, both Experiment#1 and Experiment#5

31、on error conditions covers this range, the other experiments do not. NOTE: The MNRU is a device designed for producing speech correlated noise that sounds subjectively like the quantising noise produced by log-companded PCM codecs. The device is subjectively calibrated for Mean Opinion Scores (MOS)

32、against Q dB (where Q is the ratio of the speech to speech-correlated noise power). The Equivalent Q of the codecs under test can be found from the corresponding MOS on the calibration curve of the MNRU (S-shaped curve). Only four laboratories ran tests which followed the Pre-selection Test Plan des

33、cribed in SEG-4 (BT/lab1, CNET/lab2, Tele Denmark/lab3, NEC/lab4). MOTOROLA/lab5 participated in the Pre-selection Phase but their experiments did not comply with SEG-4. TI/lab8 ran one experiment only from SEG-4. Results produced by COMSAT/lab6 following a NOKIA-designed test plan are part of stand

34、ardization of the codec in North America and NOKIA/lab7 performed complementary experiments during the ETSI Pre-selection Phase. As no further analysis have been undertaken to allow the averaging of scores across the different laboratories, results are reported in the annex on a laboratory-by-labora

35、tory basis. For error and tandeming conditions, results are reported in terms of Equivalent Q (dB) values. For background noise conditions and talker dependency, results are reported in terms of DMOS values with either Confidence Interval (CI) or Standard Deviation (SD) as there is insufficient data

36、 available to normalise across laboratories via MNRU conditions. The quality performance of the EFR codec is compared to High and Low references introduced in permanent documents SEG-3 (ETSI SMG2 SEG: SEG-3 “Selection Criteria for the Enhanced Full Rate Speech Coding Algorithm Speech Quality Require

37、ments“) and SEG-4 (ETSI SMG2 SEG: SEG-4 (v 1.0) “A Subjective Pre-Selection Test Plan for the Enhanced Full Rate Speech Coding Algorithm“, Section 7). These references were chosen as representative of the “minimum“ and “objective“ performance targets respectively, and are reported in table 1. ETSI E

38、TSI TR 146 055 V13.0.0 (2016-01)73GPP TR 46.055 version 13.0.0 Release 13Table 1: References per condition: High Ref., Low Ref. And G.728 EXPERIMENTS (SEG-4) Conditions High Ref Low Ref EXP#1 EP0 G.728 G.728 EXP#1 EP1 MNRU 24 dB TCH-FS (EP1) EXP#1 EP2 TCH-FS (EP1) TCH-FS (EP2) EXP#5 EP3 TCH-FS (EP2)

39、 TCH-FS (EP3) EXP#1 EP0 (tandem) G.728 G.728 EXP#1 EP1 (tandem) TCH-FS (EP1) TCH-FS (EP1 tandem) EXP#2 Vehicle 10 G.728 G.728EXP#3 Music 20 G.728 G.728 EXP#4 ale Talkers G.728 G.728EXP#4 Female Talkers G.728 G.728 EXP#4 Children G.728 G.728 A figure showing the general trend of the EFR behaviour for

40、 error conditions in noise-free environment, compared to the high (G.728) and low (TCH-FS) references is added to individual laboratories quantitative results (figure 15). The general quality performance of the EFR codec is summarised in table 15. In the Verification Phase, the behaviour of the EFR

41、codec under the following test conditions was tested: - behaviour of the DTX System; - performance with DTMF tones; - performance with network information tones; - performance with special input signals; - performance with music signals; - performance with noise signals; - performance with different

42、 languages; - delay of the TCH-EFR; - frequency response; - complexity. The results of these tests are also included in this report under the respective clauses. Furthermore, the EFR codec was checked for correct functioning for the following items: - test of overload point; - SID frame encoding; -

43、muting behaviour; - idle channel behaviour. No artefact or malfunctioning was detected for these items. ETSI ETSI TR 146 055 V13.0.0 (2016-01)83GPP TR 46.055 version 13.0.0 Release 131 Scope The present document gives background information on the performance of the GSM enhanced full rate speech cod

44、ec. Experimental results from the Pre-selection and Verification tests carried out during the standardization process by the SEG (Speech Expert Group) are reported to give a more detailed picture of the behaviour of the GSM enhanced full rate speech codec under different conditions of operation. 2 R

45、eferences The following documents contain provisions which, through reference in this text, constitute provisions of the present document. References are either specific (identified by date of publication, edition number, version number, etc.) or non-specific. For a specific reference, subsequent re

46、visions do not apply. For a non-specific reference, the latest version applies. In the case of a reference to a 3GPP document (including a GSM document), a non-specific reference implicitly refers to the latest version of that document in the same Release as the present document. 1 GSM 03.05: “Digit

47、al cellular telecommunications system (Phase 2+); Technical performance objectives“. 2 GSM 03.50: “Digital cellular telecommunications system (Phase 2+); Transmission planning aspects of the speech service in the GSM Public Land Mobile Network (PLMN) system“. 3 GSM 06.08: “Digital cellular telecommu

48、nications system (Phase 2+); Half rate speech; Performance of the GSM half rate speech codec“. 4 GSM 06.10: “Digital cellular telecommunications system (Phase 2+); Full rate speech transcoding“. 5 GSM 06.20: “Digital cellular telecommunications system (Phase 2+); Half rate speech transcoding“. 3 Abb

49、reviations For the purposes of the present document, the following abbreviations apply: A/D Analogue to Digital ADPCM Adaptive Differential Pulse Code Modulation ACR Absolute Category Rating BSC Base Station Controller BTS Base Transceiver Station C/I Carrier-to-Interferer ratio CI Confidence Interval CNI Comfort Noise Insertion CRC Cyclic Redundancy Check D/A Digital to Analogue DAT Digital Audio TapeDCR Degradation Category Rating DSP Digital Signal ProcessorDTMF Dual Tone Multi Frequency DTX Discontinuous Transmission for power consumption and int