1、ETSI TS I01 512 V8.1.1 (2001-03) Technical Specification Digital cellular telecommunications system (Phase 2+); Minimum Performance Requirements for Noise Suppresser Application to the AMR Speech Encoder (3GPP TS 06.77 version 8.1.1 Release 1999) 3GPP TS 06.77 version 8.1.1 Release 1999 1 Reference
2、RTS/TSGS-O40677Q7RI Keywords GSM ETSI 650 Route des Lucioles F-O6921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 O0 Fax: +33 4 93 65 47 16 Siret No 348 623 562 O0017 - NAF 742 C Association but non lucratif enregistre la Sous-prfecture de Grasse (06) No 7803/88 Important notice ETSI TS 101
3、512 V8.1.1 (2001-03) Individual copies of the present document can be downloaded from: htttx/w.etsi. org The present document may be made available in more than one electronic version or in print. In any ase of existing c perceived difference in contents between such versions, the reference version
4、is the Portable Document Format (PDF). In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status.
5、 Information on the current status of this and other ETSI documents is available at hi%:i/wc%lw.esi.or/b/slatis/ If you find errors in the present document, send your comment to: ed itoretsi .fr Copyright No tification No part may be reproduced except as authorized by written permission. The copyrig
6、ht and the foregoing restriction extend to reproduction in all media. O European Telecommunications Standards Institute 2001. All rights reserved. ETSI 3GPP TS 06.77 version 8.1.1 Release 1999 2 ETSI TS 101 512 V8.1.1 (2001-03) Intellectual Property Rights IPRs essential or potentially essential to
7、the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR O00 3 14: “Intellectual Property Rights (IPRs); Essential, orpotentially Essential, IPRs notjed to ETSI
8、 in respect OfETSIstandards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (-). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs no
9、t referenced in ETSI SR O00 3 14 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Foreword This Technical Specification (TS) has been produced by the ETSI 3d Generation Partnership Project (3GPP). The present document may refer to techni
10、cal specifications or reports using their 3GPP identities, UMTS identities or GSM identities. These should be interpreted as being references to the corresponding ETSI deliverables. The cross reference between GSM, UMTS, 3GPP and ETSI identities can be found under www.etsi.ordkey . ETSI 3GPP TS 06.7
11、7 version 8.1.1 Release 1999 3 ETSI TS 101 512 V8.1.1 (2001-04) Contents Foreword 6 1 2 3 3.1 3.2 4 4.1 5 5.1 5.2 5.3 5.4 6 6.1 6.1.1 6.1.2 6.1.3 6.1.4 7 7.1 7.2 8 8.1 8.2 8.3 8.4 8.5 9 10 11 12 13 Scope 7 References 7 Definitions and abbreviations . .7 Definitions . 7 Abbreviations 7 Description of
12、 Noise Suppression applied to AMR . 8 Applicability of Noise Suppression to Basic Services. . . 8 Requirements to be assessed by Objective Means . 8 Bit Exactness of the Speech Encoder 8 Bit Exactness of the Speech Decoder 9 Impact on Speech Path Del . . 9 . 9 Impact on Channel Activity . Requiremen
13、ts to be assessed by subjective tests 10 Impact on Speech Quality Initial Convergence Time No Degradation in Clean Speech . Quality Impact compared to AMR 10 10 . 10 10 10 No degradation of Speech and no Undesirable Effects in Residual Noise in Conditions with Background Noise (residual noise = back
14、ground noise after AMR/NS) Performance Objectives assessed by Objective Measures . 11 Impact on Active Speech Level . 11 Objective Speech Quality Measures . . 11 Interaction with supplementary services 12 General 12 Explicit Call Transfer (ECT) . 12 Call wait/Call hold . 12 .12 Multiparty . .12 Serv
15、ice Announcements . Interaction with Alternate and Followed by services . 12 Interaction with other speech services . 12 Interaction with DTMF and other signalling tones 12 Interaction with Lawful Intercept 12 Interaction with TFO . 12 Annex A (informative): Method for generating Objective Performan
16、ce Measures 13 . 13 . 14 . 14 A. 1 Notations A.3 Objective measures for characterization of NS algorithm effect ETSI 3GPP TS 06.77 version 8.1.1 Release 1999 4 ETSI TS 101 512 V8.1.1 (2001-04) Annex B (normative): Methodology for Measuring Subjective SNR Improvement for CCR Experiments . 19 Annex C
17、(normative): Test Plan for Checking Conformance to Requirements 20 C 1. Introduction . .2 1 C2 Document Structure . 2 1 C3. References, Conventions, and Contacts . 22 C4a Key Acronyms 22 Contact Names 23 C4b C5 Roles and Responsibilities . 24 C6 Information relevant to all Experiments 25 C6.1 Genera
18、l Technical Notes . 25 C6.2 Codec Adaptation and Error Conditions . 25 C6.3 Speech Material 25 C6.3.1 Availability of Pre-recorded Speech Material 26 C6.3.2 Recording Your Own Speech Databases 26 C6.3.3 Format for Single Sentence Speech Samples 26 C6.3.4 Format for Short Speech Samples . 26 C6.3.5 F
19、ormat for Long Speech Samples . 27 C6.3.6 Processing of the Speech Files . 27 C6.4 Listening Environment . . 28 C6.5 Experimental Procedure . 29 C6.6 Preliminary Conditions . . 29 C6.7 Reference Conditions . 29 C6.8 Noise Material . 29 C7. Experiment 1 : Degradation in Clean Speech (Pair Comparison
20、Test) .3 1 31 C7.1 Introduction . C7.2. Test Factors ns 31 C7.3 Preliminary Conditions . 33 C7.4 Speech Material 33 C7.5 Experimental Design. 34 C7.6 Processing. 34 C7.7 Randomizations 34 C7.8 Duration of the PC Experiment. 34 C7.9 Votes Per Condition 34 C7.10 Test Procedure 35 C7.12. Statistical An
21、alysis . 35 C7.13. Test Conditions for Experiment 1 . 37 C8 Noise in Conditions with Background Noise (ACR) . 38 C8.1 Introduction . 38 C8.2 Test Factors and Conditions . 38 C8.3 Preliminary Conditions . 39 40 C8.4 Speech Material . . 41 C8.5 Experimental Design . 41 C8.6 Processing . 41 C8.7 Random
22、izations . C8.8 Duration of and 2c 41 C8.9 Votes Per C 41 41 C8.10 Test Procedure . 42 C8.11 Opinion Scale . C8.12 Test Conditions for Experiments 2a, 2b and 2c 43 C8.13 Statistical Analysis . 44 C9. Experiments 3a knse and ICse are the corresponding index and total number of noise only frames ETSI
23、3GPP TS 06.77 version 8.1.1 Release 1999 1 NPLR, =-cNPLR, I j=l lJ NPLR = -c NPLR, 18 ETSI TS 101 512 V8.1.1 (2001-04) Furthermore, it is informative to record separately the noise type specific NPLR measures, or NPLRj, for each j. Comparison of SNRI and NPLR. A comparison of the SNRI and NPLR measu
24、res can be used to acquire an indication of possible speech distortion produced by the tested NS method. If the NPLR parameter assumes clearly higher absolute values than SNRI, it can be expected that the NS candidate causes distortion to speech. This relation, however, should always be verified thr
25、ough a comparison with subjective test results. ETSI 3GPP TS 06.77 version 8.1.1 Release 1999 19 ETSI TS 101 512 V8.1.1 (2001-04) Noise type Car Street Babble Annex B (normative): Methodology for Measuring Subjective SNR Improvement for CCR Experiments SNR dB 6, 15 9, 18 9,18 The purpose of experime
26、nt 3 is to evaluate the performances of the NS algorithm in background noise conditions with two different bit-rates (5.9 kbps and 12.2 kbps). For these experiments three types of noise have been selected: car noise, street noise and babble noise. For each type of noise two different nominal SNR lev
27、els have been set: 1 I For each sub-experiment and for each type of noise three ideal NS reference conditions will be processed. The exception is that for the higher SNRs (15dB for car noise and 18 dB for street, babble noise) only 2 ideal noise reference conditions will be tested (+3, +6dB): Ideal
28、SNR improvement SNR sub-exp. +6 dB Each ideal NS will be compared during the sub-experiment with the speech+noise signals mixed at the nominal SNR levels. This leads to a total number of CCR reference results of 5 per sub-experiment corresponding to 3 (2 for the higher SNRs) SNR improvement levels.
29、By connecting adjacent point by straight lines we will obtain a graph giving a correspondence between CCR scores and perceived SNR improvement (cf. figure B. 1). Finally the perceived SNR improvement for an AMR-NS candidate is obtained using the CCR vs SNR graph as illustrated in figure B. 1. SNR im
30、provement dB . +3 dB improvement +6 dB +9 dB 3 2 1 O CCR scale Figure B.I. Example of CCR versus SNR improvement graph O: ideal NS score, *:AMR-NS candidate score. ETSI 3GPP TS 06.77 version 8.1.1 Release 1999 20 ETSI TS 101 512 V8.1.1 (2001-04) Annex C (normative):Test Plan for Checking Conformance
31、 to Requirements Document History: Issue O. I Issue 0.2 Issue 0.3 Issue 0.4 Issue 0.5 Issue 0.6 Issue 0.7 Issue 0.8 Issue 0.9 Issue 0.10 Issue O. 1 1 Issue 0.12 Issue 2.0.0 16 Mar O0 28 Mar O0 31 Mar O0 23 May O0 19 June O0 05 Sept O0 19 Oct O0 25.0ct.00 27 Oct O0 16 Jan O1 18 Jan O1 22 Jan O1 22 Ja
32、n O1 First Issue, derived from the AMR/NS Selection Test Plan version 2.2 (Tdoc. SMG1 US4 356/99 R3) D. Pascal (France Tlcom R Various editorial modifications S. ARelak (Motorola): Insertion of section on CCR tests + Annex A.3 S. ARelak (Motorola): Mainly additions/changes to CCR tests D. Pascal (Fr
33、ance Tlcom R sentence pairs, 8 seconds in length. Long samples; sentence quadruplets, 16 seconds in length. The experiment investigating the equivalence of the candidate Noise Suppresser algorithms to the AMR algorithm without noise suppression in a quiet environment (PC experiment 1) will use the s
34、ingle sentence stimuli. The experiments investigating the possible introduction of artifacts and clipping by the candidate Noise Suppresser algorithms (ACR experiments 2a, 2b 3OdBA Hoth Spectrum (as defined by ITU-T, Recommendation P.800, Annex A, section A.1.1.2.2.1 Room Noise, with table A.l and F
35、igure A.l) measured at the head position of the subject. This will help ensure consistency between the different subjects in the same laboratory as well as across the different laboratories in which these experiments will be performed. The following points should be adhered to: Where the experiment
36、design and the listening environment allows for multiple subjects in each listening session, the requirements stated above apply to each of the positions the subjects will occupy. Where there are multiple simultaneous subjects, they should not be able to see the responses made by other subjects. All
37、 test stimuli will be presented to the subjects over a telephone handset with Modified IRS receiving response (exclusive of the SRAEN filter). Any deviation shall be reported, e.g. use of one ear-piece in a headphone. ETSI 3GPP TS 06.77 version 8.1.1 Release 1999 29 ETSI TS 101 512 V8.1.1 (2001-04)
38、C6.5 Subjects should be told not to discuss the experiment with subjects who are yet to participate. Any test house performing multiple experiments must use different listening subjects for each experiment or sub-experiment. Experimental Procedure Initially the experimenter should present and explai
39、n the experiment instructions to the subjects. When the subject has understood the instructions, they will first listen and give score to the preliminary conditions. After the preliminaries have been completed, there should be sufficient time allowed for answering possible questions from the subject
40、s. Any questions about the procedure or the meaning of the instructions should be answered, but any technical questions on matters such as the experimental methodology or details of the types of distortions they are listening to must not be answered until they have completed the experiment. C6.6 Pre
41、liminary Conditions Preliminary conditions are included in the experiment to help acclimatize the subjects with the experimental procedure and to help reduce learning effects of the subjects, by ensuring that the subjects hear a full range of the potential qualities at the start of the experiment. N
42、o suggestions should be made to the subjects that the preliminary samples include the best or worst in the range to be covered, or exhaust the range of conditions they can expect to hear. C6.7 Reference Conditions Four types of reference conditions are used in these experiments: AMR without NS Refer
43、ences: These are to be used to determine how the AMR Noise Suppresser performs in relation to these. Direct unprocessed speech plus noise source material. MNRU references: These are included as standard references of known and well understood performance and will allow the results to be expressed in
44、 terms of Equivalent Q as well as MOS for the ACR tests. MNRUs are also included in the CCR tests as references to estimate the test sensitivity and explore most of the CMOS range. For the CCR experiments, relative MNRU comparisons are used to estimate the test sensitivity. For example an MNRU of 12
45、 may be compared to an MNRU of 16. If this difference is just above the significance level, it represents the test sensitivity. Ideal noise suppression levels: These are represented by varying the SNR level between the speech and noise. These conditions are AMR processed. This is an attempt to defin
46、e equivalent noise suppression levels. For the Tests involving background noise conditions, the MNRU references will use noisy speech (i.e. background noise will be used with the MNRU). The exact number of each of these types of reference in each experiment can be found in the experiment plans in th
47、e sections 7-10. C6.8 Noise Material Most of the Noise Suppresser Selection Test Experiments require the addition of noise to the speech material. The following types of noise are identified in this test plan: Car Noise: This represents stationary (static) background noise and will be typical of the noise experienced when inside a moving vehicle (car) at a constant speed. ETSI
