1、 TIA-718-E-1E December 2013Minimum Performance Specification for the Enhanced Variable Rate Codec, Speech Service Options 3, 68, 70, 73 and 77 for Wideband Spread Spectrum Digital Systems NOTICE TIA Engineering Standards and Publications are designed to serve the public interest through eliminating
2、misunderstandings between manufacturers and purchasers, facilitating interchangeability and improvement of products, and assisting the purchaser in selecting and obtaining with minimum delay the proper product for their particular need. The existence of such Standards and Publications shall not in a
3、ny respect preclude any member or non-member of TIA from manufacturing or selling products not conforming to such Standards and Publications. Neither shall the existence of such Standards and Publications preclude their voluntary use by Non-TIA members, either domestically or internationally. Standa
4、rds and Publications are adopted by TIA in accordance with the American National Standards Institute (ANSI) patent policy. By such action, TIA does not assume any liability to any patent owner, nor does it assume any obligation whatever to parties adopting the Standard or Publication. This Standard
5、does not purport to address all safety problems associated with its use or all applicable regulatory requirements. It is the responsibility of the user of this Standard to establish appropriate safety and health practices and to determine the applicability of regulatory limitations before its use. (
6、From Project No. TIA-PN-718-E-1E, formulated under the cognizance of the TIA TR-45 Mobile (b) there is no assurance that the Document will be approved by any Committee of TIA or any other body in its present or any other form; (c) the Document may be amended, modified or changed in the standards dev
7、elopment or any editing process. The use or practice of contents of this Document may involve the use of intellectual property rights (“IPR”), including pending or issued patents, or copyrights, owned by one or more parties. TIA makes no search or investigation for IPR. When IPR consisting of patent
8、s and published pending patent applications are claimed and called to TIAs attention, a statement from the holder thereof is requested, all in accordance with the Manual. TIA takes no position with reference to, and disclaims any obligation to investigate or inquire into, the scope or validity of an
9、y claims of IPR. TIA will neither be a party to discussions of any licensing terms or conditions, which are instead left to the parties involved, nor will TIA opine or judge whether proposed licensing terms or conditions are reasonable or non-discriminatory. TIA does not warrant or represent that pr
10、ocedures or practices suggested or provided in the Manual have been complied with as respects the Document or its contents. If the Document contains one or more Normative References to a document published by another organization (“other SSO”) engaged in the formulation, development or publication o
11、f standards (whether designated as a standard, specification, recommendation or otherwise), whether such reference consists of mandatory, alternate or optional elements (as defined in the TIA Engineering Manual, 4thedition) then (i) TIA disclaims any duty or obligation to search or investigate the r
12、ecords of any other SSO for IPR or letters of assurance relating to any such Normative Reference; (ii) TIAs policy of encouragement of voluntary disclosure (see Engineering Manual Section 6.5.1) of Essential Patent(s) and published pending patent applications shall apply; and (iii) Information as to
13、 claims of IPR in the records or publications of the other SSO shall not constitute identification to TIA of a claim of Essential Patent(s) or published pending patent applications. TIA does not enforce or monitor compliance with the contents of the Document. TIA does not certify, inspect, test or o
14、therwise investigate products, designs or services or any claims of compliance with the contents of the Document. ALL WARRANTIES, EXPRESS OR IMPLIED, ARE DISCLAIMED, INCLUDING WITHOUT LIMITATION, ANY AND ALL WARRANTIES CONCERNING THE ACCURACY OF THE CONTENTS, ITS FITNESS OR APPROPRIATENESS FOR A PAR
15、TICULAR PURPOSE OR USE, ITS MERCHANTABILITY AND ITS NONINFRINGEMENT OF ANY THIRD PARTYS INTELLECTUAL PROPERTY RIGHTS. TIA EXPRESSLY DISCLAIMS ANY AND ALL RESPONSIBILITIES FOR THE ACCURACY OF THE CONTENTS AND MAKES NO REPRESENTATIONS OR WARRANTIES REGARDING THE CONTENTS COMPLIANCE WITH ANY APPLICABLE
16、 STATUTE, RULE OR REGULATION, OR THE SAFETY OR HEALTH EFFECTS OF THE CONTENTS OR ANY PRODUCT OR SERVICE REFERRED TO IN THE DOCUMENT OR PRODUCED OR RENDERED TO COMPLY WITH THE CONTENTS. TIA SHALL NOT BE LIABLE FOR ANY AND ALL DAMAGES, DIRECT OR INDIRECT, ARISING FROM OR RELATING TO ANY USE OF THE CON
17、TENTS CONTAINED HEREIN, INCLUDING WITHOUT LIMITATION ANY AND ALL INDIRECT, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES (INCLUDING DAMAGES FOR LOSS OF BUSINESS, LOSS OF PROFITS, LITIGATION, OR THE LIKE), WHETHER BASED UPON BREACH OF CONTRACT, BREACH OF WARRANTY, TORT (INCLUDING NEGLIGENCE), PRODUCT
18、LIABILITY OR OTHERWISE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. THE FOREGOING NEGATION OF DAMAGES IS A FUNDAMENTAL ELEMENT OF THE USE OF THE CONTENTS HEREOF, AND THESE CONTENTS WOULD NOT BE PUBLISHED BY TIA WITHOUT SUCH LIMITATIONS. 3GP2 C.S0018-E v2.0 REVISION HISTORY Revision Descripti
19、on Date C.S018-0 v1.0 Minimum Performance Specification for the Enhanced Variable Rate Codec, Spech Service Option 3 for Spread Spectrum Digital Systems December 199 C.S018-B v1.0 Minimum Performance Specification for the Enhanced Variable Rate Codec, Spech Service Options 3 and 68 for Spread Spectr
20、um Digital Systems August 207 C.S018-C v1.0 Minimum Performance Specification for the Enhanced Variable Rate Codec, Spech Service Options 3, 68, and 70 for Spread Spectrum Digital Systems December 207 C.S018-D v1.0 Minimum Performance Specification for the Enhanced Variable Rate Codec, Spech Service
21、 Options 3, 68, 70, and 73 for Spread Spectrum Digital Systems January 25, 2010 C.S018-E v1.0 Minimum Performance Specification for the Enhanced Variable Rate Codec, Spech Service Options 3, 68, 70, 73 and 7 for Spread Spectrum Digital Systems December 201 C.S018-E v2.0 Minimum Performance Specifica
22、tion for the Enhanced Variable Rate Codec, Spech Service Options 3, 68, 70, 73 and 7 for Spread Spectrum Digital Systems March 2013 C.S018-E v2.0 Replacement publication text, footnotes 8 and 9 were modified. September 2013 3GPP2 C.S0018-E v2.0 i FOREWORD 1 (This foreword is not part of this documen
23、t.) 2 This document specifies the procedures to test implementations of EVRC-A, EVRC-B, EVRC-WB, 3 EVRC-NW or EVRC-NW2K compatible variable-rate speech codecs either by meeting the bit-exact 4 implementation, or meeting recommended minimum performance requirements. The EVRC-A is the 5 Service Option
24、 3 (SO 3) speech codec, the EVRC-B is the Service Option 68 (SO 68) speech codec, 6 the EVRC-WB is the Service Option 70 (SO 70) speech codec, EVRC-NW is the Service Option 73 7 (SO 73) speech codec and the EVRC-NW2K is the Service Option 77 (SO 77) speech codec. 8 9 3GPP2 C.S0018-E v2.0 ii This pag
25、e intentionally left blank 1 3GPP2 C.S0018-E v2.0 iii CONTENTS 1 1 Introduction 1-1 2 1.1 Scope 1-2 3 1.2 Requirements Language 1-3 4 1.3 References . 1-3 5 1.3.1 Normative References . 1-3 6 1.3.2 Informative References 1-4 7 1.4 Definitions . 1-5 8 1.5 Test Model for the Speech Codec 1-7 9 2 Codec
26、 Minimum Standards . 2-1 10 2.1 Performance Testing for SO 3 2-1 11 2.1.1 Objective Performance Testing for SO 3 . 2-1 12 2.1.1.1 Average Data Rate Test 2-1 13 2.1.1.1.1 Average Data Rate Computation 2-1 14 2.1.1.1.2 Average Data Rate Requirement 2-2 15 2.1.1.2 Unity Gain Requirement 2-2 16 2.1.1.3
27、End-to-end Algorithmic Delay Recommendation . 2-2 17 2.1.2 Subjective Performance Testing for SO 3 2-2 18 2.1.2.1 Definition 2-3 19 2.1.2.2 Method of Measurement 2-3 20 2.1.2.3 Test Conditions and Test Design for SO 3 Listening Experiments . 2-3 21 2.1.2.3.1 Subjective Experiment I for SO 3 . 2-3 22
28、 2.1.2.3.2 Subjective Experiment II for SO 3 2-5 23 2.1.2.3.3 Numerical Parameters for SO 3 Listening Experiments . 2-7 24 2.1.3 Source Speech Material for SO 3 Testing 2-7 25 2.1.3.1 Source Speech Material for Experiment I 2-7 26 2.1.3.2 Source Speech Material for Experiment II . 2-8 27 2.1.4 Proce
29、ssing of Speech Material for SO 3 Testing . 2-8 28 2.1.4.1 Encoding by the Test Codec 2-9 29 2.1.4.2 Decoding by the Master/Test Codecs 2-9 30 2.1.4.3 Introduction of Impairments . 2-9 31 2.1.4.4 Tandem Conditions . 2-9 32 3GPP2 C.S0018-E v2.0 iv 2.1.4.5 Rate 1/2 Maximum Processing 2-10 1 2.1.4.6 En
30、suring Proper Encoded Frame Packet Files . 2-10 2 2.1.5 Randomization . 2-10 3 2.1.6 Presentation . 2-11 4 2.1.7 Listeners . 2-11 5 2.1.8 Listening Test Procedures . 2-11 6 2.1.9 Analysis of Results . 2-12 7 2.1.10 Minimum Subjective Requirement 2-13 8 2.1.11 Expected Results for Reference Condition
31、s . 2-15 9 2.2 Performance Testing for SO 68 2-16 10 2.2.1 Objective Performance Testing for SO 68 . 2-16 11 2.2.1.1 Average Data Rate Test 2-16 12 2.2.1.1.1 Average Data Rate Computation for SO 68 . 2-16 13 2.2.1.1.2 Average Data Rate Requirement for SO 68 . 2-17 14 2.2.1.2 Unity Gain Requirement 2
32、-17 15 2.2.1.3 End-to-end Algorithmic Delay Recommendation . 2-17 16 2.2.2 Subjective Performance Testing for SO 68 2-18 17 2.2.2.1 Definition 2-18 18 2.2.2.2 Method of Measurement 2-18 19 2.2.2.3 Test Conditions and Test Design for SO 68 2-18 20 2.2.2.3.1 Subjective Experiment I for SO 68 . 2-18 21
33、 2.2.2.3.2 Subjective Experiment II for SO 68 2-20 22 2.2.2.3.3 Numerical Parameters for the SO 68 Listening Experiments . 2-21 23 2.2.3 Speech Material for SO 68 Testing 2-22 24 2.2.3.1 Source Speech Material for SO 68 Experiment I . 2-23 25 2.2.3.2 Source Speech Material for SO 68 Experiment II 2-
34、23 26 2.2.4 Processing of Speech Material for SO 68 Testing . 2-23 27 2.2.4.1 Encoding by the Test Codec 2-24 28 2.2.4.2 Decoding by the Master/Test Codecs 2-24 29 2.2.4.3 Introduction of Impairments . 2-24 30 2.2.4.4 Ensuring Proper Encoded Frame Packet Files . 2-24 31 2.2.4.5 Post-processing of te
35、st-condition output files 2-24 32 3GPP2 C.S0018-E v2.0 v 2.2.5 Randomization . 2-26 1 2.2.6 Presentation . 2-28 2 2.2.7 Listeners . 2-28 3 2.2.8 Listening Test Procedures . 2-28 4 2.2.8.1 ACR Listening Test Procedures Experiment I. . 2-28 5 2.2.8.2 P-835 Listening Test Procedures Experiment II . 2-2
36、9 6 2.2.9 Analysis of Results . 2-32 7 2.2.9.1 Basic Results for the SO 68 Listening tests 2-32 8 2.2.9.2 Minimum Subjective Requirement for SO 68 Listening Tests . 2-32 9 2.2.10 Expected Results for Reference Conditions . 2-33 10 2.2.10.1 Experiment I Reference Conditions 2-33 11 2.2.10.2 Experimen
37、t II Reference Conditions . 2-33 12 2.3 Performance Testing for SO 70 2-34 13 2.3.1 Objective Performance Testing for SO 70 . 2-34 14 2.3.1.1 Average Data Rate Test 2-34 15 2.3.1.1.1 Average Data Rate Computation for SO 70 . 2-34 16 2.3.1.1.2 Average Data Rate Requirement for SO 70 . 2-35 17 2.3.1.2
38、 Unity Gain Requirement 2-35 18 2.3.1.3 End-to-end Algorithmic Delay Recommendation . 2-36 19 2.3.2 Subjective Performance Testing for SO 70 2-36 20 2.3.2.1 Definition 2-38 21 2.3.2.2 Method of Measurement 2-39 22 2.3.2.3 Test Conditions and Test Design for SO 70 2-39 23 2.3.2.3.1 Subjective Experim
39、ent 1 for SO 70 2-39 24 2.3.2.3.2 Subjective Experiment 2 for SO 70 2-41 25 2.3.2.3.3 Subjective Experiment 3 for SO 70 2-43 26 2.3.2.3.4 Subjective Experiment 4 for SO 70 2-44 27 2.3.2.3.5 Subjective Experiment 5 for SO 70 2-46 28 2.3.2.3.6 Subjective Experiment 6 for SO 70 2-47 29 2.3.2.3.7 Subjec
40、tive Experiment 7 for SO 70 2-49 30 2.3.2.3.8 Subjective Experiment 8 for SO 70 2-50 31 2.3.2.3.9 Numerical Parameters for the SO 70 Listening Experiments . 2-50 32 2.3.3 Speech Material for SO 70 Testing 2-51 33 3GPP2 C.S0018-E v2.0 vi 2.3.4 Processing of Speech Material for SO 70 Testing . 2-51 1
41、2.3.4.1 Encoding by the Test Codec 2-52 2 2.3.4.2 Decoding by the Master/Test Codecs 2-52 3 2.3.4.3 Introduction of Impairments . 2-52 4 2.3.4.4 Ensuring Proper Encoded Frame Packet Files . 2-52 5 2.3.4.5 Post-processing of test-condition output files 2-53 6 2.3.5 Randomization . 2-55 7 2.3.6 Presen
42、tation . 2-57 8 2.3.7 Listeners . 2-57 9 2.3.8 Listening Test Procedures . 2-57 10 2.3.8.1 ACR Listening Test Procedures Experiments 1, 3, and 5 2-57 11 2.3.8.2 P-835 Listening Test Procedures Experiments 2, 4, and 6 2-58 12 2.3.9 Analysis of Results . 2-61 13 2.3.9.1 Basic Results for the SO 70 Lis
43、tening tests 2-61 14 2.3.9.2 Minimum Subjective Requirement for SO 70 Listening Tests . 2-61 15 2.3.10 Expected Results for Reference Conditions . 2-62 16 2.3.10.1 Reference Conditions for Experiments 1, 3, and 5 . 2-62 17 2.3.10.2 Reference Conditions for Experiments 2, 4, and 6 . 2-62 18 2.4 Perfo
44、rmance Testing for SO 73 2-63 19 2.4.1 Objective Performance Testing for SO 73 . 2-63 20 2.4.1.1 Average Data Rate Test 2-63 21 2.4.1.1.1 Average Data Rate Computation for SO 73 . 2-63 22 2.4.1.1.2 Average Data Rate Requirement for SO 73 . 2-65 23 2.4.1.2 Unity Gain Requirement 2-65 24 2.4.1.3 End-t
45、o-end Algorithmic Delay Recommendation . 2-65 25 2.4.2 Subjective Performance Testing for SO 73 2-65 26 2.4.2.1 Definition 2-67 27 2.4.2.2 Method of Measurement 2-67 28 2.4.2.3 Test Conditions and Test Design for SO 73 2-67 29 2.4.2.3.1 Subjective Experiment 1 for SO 73 2-67 30 2.4.2.3.2 Subjective
46、Experiment 2 for SO 73 2-69 31 2.4.2.3.3 Subjective Experiment 3 for SO 73 2-70 32 3GPP2 C.S0018-E v2.0 vii 2.4.2.3.4 Subjective Experiment 4 for SO 73 2-72 1 2.4.2.3.5 Subjective Experiment 5 for SO 73 2-74 2 2.4.2.3.6 Subjective Experiment 6 for SO 73 2-75 3 2.4.2.3.7 Numerical Parameters for the
47、SO 73 Listening Experiments . 2-76 4 2.4.3 Speech Material for SO 73 Testing 2-77 5 2.4.4 Processing of Speech Material for SO 73 Testing . 2-77 6 2.4.4.1 Encoding by the Test Codec 2-78 7 2.4.4.2 Decoding by the Master/Test Codecs 2-78 8 2.4.4.3 Introduction of Impairments . 2-78 9 2.4.4.4 Ensuring
48、 Proper Encoded Frame Packet Files . 2-78 10 2.4.4.5 Post-processing of test-condition output files 2-78 11 2.4.5 Randomization . 2-80 12 2.4.6 Presentation . 2-82 13 2.4.7 Listeners . 2-82 14 2.4.8 Listening Test Procedures . 2-82 15 2.4.8.1 ACR Listening Test Procedures Experiments 1 and 3 . 2-82
49、16 2.4.8.2 P-835 Listening Test Procedures Experiments 2 and 4 . 2-83 17 2.4.9 Analysis of Results . 2-86 18 2.4.9.1 Basic Results for the SO 73 Listening tests 2-86 19 2.4.9.2 Minimum Subjective Requirement for SO 73 Listening Tests . 2-86 20 2.4.10 Expected Results for Reference Conditions . 2-87 21 2.4.10.1 Reference Conditions for Experiments 1, 3, and 5 . 2-87 22 2.4.10.2 Reference Conditions for Experiments 2 and 4 2-87 23 2.5 Performance Testing for SO 77 2-88 24 2.5.1 Objective Performance Testing for SO 77 . 2-88 25 2.5.1.1 Average Data Rate Test 2-88 26 2.5.1.1.1