1、 ETSI TS 103 106 V1.4.1 (2016-11) Speech and multimedia Transmission Quality (STQ); Speech quality performance in the presence of background noise: Background noise transmission for mobile terminals-objective test methods TECHNICAL SPECIFICATION ETSI ETSI TS 103 106 V1.4.1 (2016-11)2 Reference RTS/S
2、TQ-224 Keywords noise, quality, speech, testing, transmission ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Im
3、portant notice The present document can be downloaded from: http:/www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior writt
4、en authorization of ETSI. In case of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document
5、 should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at https:/portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comment to one of th
6、e following services: https:/portal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of th
7、e PDF version shall not be modified without the written authorization of ETSI. The copyright and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2016. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Trade Marks of E
8、TSI registered for the benefit of its Members. 3GPPTM and LTE are Trade Marks of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI TS 103 106 V1.4.1 (2016-11)3 Contents I
9、ntellectual Property Rights 5g3Foreword . 5g3Modal verbs terminology 5g31 Scope 6g32 References 6g32.1 Normative references . 6g32.2 Informative references 7g33 Abbreviations . 8g34 Introduction 9g35 Underlying speech databases and preparations 9g36 Modifications to the model described in ETSI EG 20
10、2 396-3 . 10g36.1 Prefiltering in Narrowband Mode (NB) . 10g36.2 Detection of the speech parts 10g36.3 Speech level adjustment in wideband . 11g36.4 Replacement of parameter regression for S-MOS 11g36.5 Retraining of parameter regression for N-MOS and G-MOS . 14g37 Comparison of objective and subjec
11、tive results after the training process . 15g37.0 General . 15g37.1 Results in wideband mode 15g37.1.0 General 15g37.1.1 Results for database “Audience - Test 3“ 15g37.1.2 Results for database “Audience - Test 3L“ (excluded during retraining) . 16g37.1.3 Results for database “Audience - Test 4“ 16g3
12、7.1.4 Results for database “Audience - Test 4L“ . 17g37.1.5 Results for database “Nokia - Test 1“ . 18g37.1.6 Results for database “Nokia - Test 2“ (excluded during retraining) . 18g37.1.7 Results for database “Orange“ 19g37.1.8 Results for database “Qualcomm - Test 3“ . 20g37.1.9 Results for databa
13、se “Qualcomm - Test 4“ . 20g37.2 Results in narrowband mode 21g37.2.0 General 21g37.2.1 Results for database “Audience - Test 1“ 21g37.2.2 Results for database “Audience - Test 1L“ . 22g37.2.3 Results for database “Audience - Test 2“ 22g37.2.4 Results for database “Audience - Test 2L“ . 23g37.2.5 Re
14、sults for database “Qualcomm- Test 1“ 24g37.2.6 Results for database “Qualcomm- Test 2“ 24g38 Validation results 25g38.0 Preamble . 25g38.1 Audience validation data 25g38.1.1 Description of tests . 25g38.1.2 Description of validation results . 27g38.1.2.1 General explanation 27g38.1.2.1 Experiment 5
15、: Narrowband . 27g38.1.2.2 Experiment 6: Narrowband . 29g38.1.2.3 Experiment 7: Wideband . 31g38.1.2.4 Experiment 8: Wideband . 33g38.2 Orange validation data 35g38.2.1 Description of tests . 35g38.2.2 Description of validation results . 36g38.3 Qualcomm validation data 37g38.3.1 Description of test
16、s . 37g3ETSI ETSI TS 103 106 V1.4.1 (2016-11)4 8.3.2 Description of validation results . 40g38.4 Validation data for additional use cases . 44g38.4.1 Tests 1 Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest
17、 updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
18、 server) which are, or may be, or may become, essential to the present document. Foreword This Technical Specification (TS) has been produced by ETSI Technical Committee Speech and multimedia Transmission Quality (STQ). The present document is to be used in conjunction with the ETSI standard series
19、EG/S 202 396 i.2 to i.4: ETSI ES 202 396 1: “Background noise simulation technique and background noise database“; ETSI EG 202 396 2: “Background noise transmission - Network simulation - Subjective test database and results“; ETSI EG 202 396-3: “Background noise transmission - Objective test method
20、s“. The present document is based on the objective test method described in ETSI EG 202 396-3 i.4 and contains modifications of the model required in order to provide a good prediction of the uplink speech quality in the presence of background noise of modern mobile terminals. Modal verbs terminolog
21、y In the present document “shall“, “shall not“, “should“, “should not“, “may“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI
22、 deliverables except when used in direct citation. ETSI ETSI TS 103 106 V1.4.1 (2016-11)6 1 Scope The present document describes testing methodologies which can be used to objectively evaluate the performance of narrowband and wideband mobile terminals for speech communication in the presence of bac
23、kground noise. Background noise is a problem in mostly all situations and conditions and needs to be taken into account in both, terminals and networks. The present document provides information about the testing methods applicable to objectively evaluate the speech quality of mobile terminals with
24、AMR and AMR-WB codecs in the presence of background noise. The present document includes: The method which is applicable to objectively determine the different parameters influencing the speech quality in the presence of background noise taking into account: - the speech quality; - the background no
25、ise transmission quality; - the overall quality. The description of the adaptation of the test method described in ETSI ES 202 396-1 i.2. The model results in comparison with the underlying subjective tests used for the retraining of the objective model. The model validation results: - Additional va
26、lidation results are provided for cases which include some conditions outside the scope of ETSI ES 202 396-1 i.2. These include music as background noise, and user holding a handset in other than nominal position, as defined in Recommendation ITU-T P.64 i.24. In addition, validation results are prov
27、ided for Chinese language. The present document is to be used in conjunction with: - ETSI ES 202 396-1 i.2 which describes a recording and reproduction setup for realistic simulation of background noise scenarios in lab-type environments for the performance evaluation of terminals and communication
28、systems. - ETSI EG 202 396-2 i.3 which describes the simulation of network impairments and how to simulate realistic transmission network scenarios and which contains the methodology and results of the subjective scoring for the data forming the basis of the present document. - ETSI EG 202 396-3 i.4
29、 which describes the basic objective model underlying to the Model described in the present document. - American English speech sentences as enclosed in the present document. 2 References 2.1 Normative references References are either specific (identified by date of publication and/or edition number
30、 or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the referenced document (including any amendments) applies. Referenced documents which are not found to be publicly available in the expected location migh
31、t be found at https:/docbox.etsi.org/Reference/. NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee their long term validity. ETSI ETSI TS 103 106 V1.4.1 (2016-11)7 The following referenced documents are necessary for the application of th
32、e present document. Not applicable. 2.2 Informative references References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the r
33、eferenced document (including any amendments) applies. NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee their long term validity. The following referenced documents are not necessary for the application of the present document but they a
34、ssist the user with regard to a particular subject area. i.1 3GPP S4-120542: “Common subjective testing framework for training of P.835 test predictors“. i.2 ETSI ES 202 396-1: “Speech and multimedia Transmission Quality (STQ); Speech quality performance in the presence of background noise; Part 1:
35、Background noise simulation technique and background noise database“. i.3 ETSI EG 202 396-2: “Speech Processing, Transmission and Quality Aspects (STQ); Speech Quality performance in the presence of background noise; Part 2: Background Noise Transmission - Network Simulation - Subjective Test Databa
36、se and Results“. i.4 ETSI EG 202 396-3: “Speech and multimedia Transmission Quality (STQ); Speech Quality performance in the presence of background noise Part 3: Background noise transmission - Objective test methods“. i.5 ETSI TS 126 073: “Digital cellular telecommunications system (Phase 2+); Univ
37、ersal Mobile Telecommunications System (UMTS); LTE; ANSI C code for the Adaptive Multi Rate (AMR) speech codec (3GPP TS 26.073)“. i.6 Recommendation ITU-T P.835: “Subjective test methodology for evaluating speech communication systems that include noise suppression algorithm“. i.7 Recommendation ITU
38、-T G.722.2: “Wideband coding of speech at around 16 kbit/s using Adaptive Multi-Rate Wideband (AMR-WB)“. i.8 Recommendation ITU-T P.56: “Objective measurement of active speech level“. i.9 Recommendation ITU-T P.1401: “Methods, metrics and procedures for statistical evaluation, qualifying and compari
39、son of objective quality prediction models“. i.10 Recommendation ITU-T G.160 Appendix II, Amendment 2: “Voice enhancement devices: Revised Appendix II - Objective measures for the characterization of the basic functioning of noise reduction algorithms“. i.11 Recommendation ITU-T G.191: “Software too
40、ls for speech and audio coding standardization“. i.12 Hastie, T.; Tibshirani, R.; Friedman, J.: “The Elements of Statistical Learning: Data Mining, Inference, and Prediction“, New York: Springer-Verlag, 2001. i.13 Recommendation ITU-T P.501: “Test Signals for Use in Telephonometry“. i.14 Recommendat
41、ion ITU-T P.58: “Head and Torso simulator for telephonometry“. i.15 Recommendation ITU-T P.57: “Artificial ears“. i.16 ETSI TS 126 131: “Universal Mobile Telecommunications System (UMTS); LTE; Terminal acoustic characteristics for telephony; Requirements (3GPP TS 26.131 version 10.2.0 Release 10)“.
42、i.17 Recommendation ITU-T P.800: “Methods for subjective determination of transmission quality“. ETSI ETSI TS 103 106 V1.4.1 (2016-11)8 i.18 ETSI TS 126 132: “Universal Mobile Telecommunications System (UMTS); LTE; Speech and video telephony terminal acoustic test specification (3GPP TS 26.132)“. i.
43、19 Void. i.20 Recommendation ITU-T TD 477 (GEN/12): “Handbook of subjective test practical procedures“ (temporary document) - Geneva, 18-27 January 2011. i.21 AH-11-029, Better Reference System for the P.835 SIG Rating Scale, Q7/12 Rapporteurs meeting, 20-21 June 2011, Geneva, Switzerland. i.22 3GPP
44、, Tdoc S4(12)0621, Ext-ATS Permanent document (EATS-3): “Common subjective testing framework for validation of P.835 test predictors“. i.23 Recommendation ITU-T P.50: “Artificial voices“. i.24 Recommendation ITU-T P.64: “Determination of sensitivity/frequency characteristics of local telephone syste
45、ms“. 3 Abbreviations For the purposes of the present document, the following abbreviations apply: AMR Adaptive MultiRate AMR-NB Adaptive Multirate Codec - Narrow Band AMR-WB Adaptive Multi-Rate Wideband Speech Codec BAK Background Noise Component dB SPL Sound Pressure Level re 20 Pa in dB DRP Drum R
46、eference Point DTX Discontinuous Transmission G-MOS Global MOS NOTE: MOS related to the overall sample. HATS Head and Torso Simulator HHHF Hand-Held Hands-FreeIRS Intermediate Reference System NTT Nippon Telegraph and Telephone ITU International Telecommunication Union ITU-T Telecommunication Standa
47、rdization Sector of ITU MOS Mean Opinion Score MRP Mouth Reference Point MSIN Mobile Station Input Filter NB NarrowBand N-MOS Noise MOSNOTE: MOS related to the noise transmission only. NS Noise Suppression OVRL Overall (speech + noise) Component RCV ReCeiVe RMSE Root Mean Square Error RMSE* epsilon
48、insensitive Root Mean Square Error SIG SIGnal component S-MOS Speech MOS NOTE: MOS related to the speech signal only. SND Sending Direction SNR Signal to Noise Ratio SPL Sound Pressure LevelWB WideBandWCDMA Wideband Code Division Multiple Access ETSI ETSI TS 103 106 V1.4.1 (2016-11)9 4 Introduction
49、The present document describes the modifications of the ETSI EG 202 396-3 i.4 model which were necessary to adapt to the training databases provided by the 3GPP contributors listed in annex A. The core model itself retains mainly unmodified except the points given in the clauses below. Modifications affect the narrow- and wideband mode in different ways. The adapted objective method described in the present document is intended to be used for all types of modern mobile terminals using different bitr
