TIA-5047-2018 Telecommunications Communications Products Speech Quality Subjective Measurement Procedures and Performance Recommendations.pdf

1、TIA-5047 June 2018Telecommunications Communications Products Speech Quality Subjective Measurement Procedures and Performance Recommendations NOTICE TIA Engineering Standards and Publications are designed to serve the public interest through eliminating misunderstandings between manufacturers and pu

2、rchasers, facilitating interchangeability and improvement of products, and assisting the purchaser in selecting and obtaining with minimum delay the proper product for their particular need. The existence of such Standards and Publications shall not in any respect preclude any member or non-member o

3、f TIA from manufacturing or selling products not conforming to such Standards and Publications. Neither shall the existence of such Standards and Publications preclude their voluntary use by Non-TIA members, either domestically or internationally. Standards and Publications are adopted by TIA in acc

4、ordance with the American National Standards Institute (ANSI) patent policy. By such action, TIA does not assume any liability to any patent owner, nor does it assume any obligation whatever to parties adopting the Standard or Publication. This Standard does not purport to address all safety problem

5、s associated with its use or all applicable regulatory requirements. It is the responsibility of the user of this Standard to establish appropriate safety and health practices and to determine the applicability of regulatory limitations before its use. Any use of trademarks in this document are for

6、information purposes and do not constitute an endorsement by TIA or this committee of the products or services of the company. (From Project No. TIA-PN-5047-R2, formulated under the cognizance of the TIA TR-41 (Performance and Accessibility for Communications Products, TR-41.3 Subcommittee on Analog

7、 and Digital Wireline Terminals). Published by TELECOMMUNICATIONS INDUSTRY ASSOCIATION Technology (b) there is no assurance that the Document will be approved by any Committee of TIA or any other body in its present or any other form; (c) the Document may be amended, modified or changed in the stand

8、ards development or any editing process. The use or practice of contents of this Document may involve the use of intellectual property rights (“IPR”), including pending or issued patents, or copyrights, owned by one or more parties. TIA makes no search or investigation for IPR. When IPR consisting o

9、f patents and published pending patent applications are claimed and called to TIAs attention, a statement from the holder thereof is requested, all in accordance with the Manual. TIA takes no position with reference to, and disclaims any obligation to investigate or inquire into, the scope or validi

10、ty of any claims of IPR. TIA will neither be a party to discussions of any licensing terms or conditions, which are instead left to the parties involved, nor will TIA opine or judge whether proposed licensing terms or conditions are reasonable or non-discriminatory. TIA does not warrant or represent

11、 that procedures or practices suggested or provided in the Manual have been complied with as respects the Document or its contents. If the Document contains one or more Normative References to a document published by another organization (“other SSO”) engaged in the formulation, development or publi

12、cation of standards (whether designated as a standard, specification, recommendation or otherwise), whether such reference consists of mandatory, alternate or optional elements (as defined in the TIA Procedures for American National Standards) then (i) TIA disclaims any duty or obligation to search

13、or investigate the records of any other SSO for IPR or letters of assurance relating to any such Normative Reference; (ii) TIAs policy of encouragement of voluntary disclosure (see TIA Procedures for American National Standards Annex C.1.2.3) of Essential Patent(s) and published pending patent appli

14、cations shall apply; and (iii) Information as to claims of IPR in the records or publications of the other SSO shall not constitute identification to TIA of a claim of Essential Patent(s) or published pending patent applications. TIA does not enforce or monitor compliance with the contents of the Do

15、cument. TIA does not certify, inspect, test or otherwise investigate products, designs or services or any claims of compliance with the contents of the Document. ALL WARRANTIES, EXPRESS OR IMPLIED, ARE DISCLAIMED, INCLUDING WITHOUT LIMITATION, ANY AND ALL WARRANTIES CONCERNING THE ACCURACY OF THE CO

16、NTENTS, ITS FITNESS OR APPROPRIATENESS FOR A PARTICULAR PURPOSE OR USE, ITS MERCHANTABILITY AND ITS NONINFRINGEMENT OF ANY THIRD PARTYS INTELLECTUAL PROPERTY RIGHTS. TIA EXPRESSLY DISCLAIMS ANY AND ALL RESPONSIBILITIES FOR THE ACCURACY OF THE CONTENTS AND MAKES NO REPRESENTATIONS OR WARRANTIES REGAR

17、DING THE CONTENTS COMPLIANCE WITH ANY APPLICABLE STATUTE, RULE OR REGULATION, OR THE SAFETY OR HEALTH EFFECTS OF THE CONTENTS OR ANY PRODUCT OR SERVICE REFERRED TO IN THE DOCUMENT OR PRODUCED OR RENDERED TO COMPLY WITH THE CONTENTS. TIA SHALL NOT BE LIABLE FOR ANY AND ALL DAMAGES, DIRECT OR INDIRECT

18、, ARISING FROM OR RELATING TO ANY USE OF THE CONTENTS CONTAINED HEREIN, INCLUDING WITHOUT LIMITATION ANY AND ALL INDIRECT, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES (INCLUDING DAMAGES FOR LOSS OF BUSINESS, LOSS OF PROFITS, LITIGATION, OR THE LIKE), WHETHER BASED UPON BREACH OF CONTRACT, BREACH OF

19、 WARRANTY, TORT (INCLUDING NEGLIGENCE), PRODUCT LIABILITY OR OTHERWISE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. THE FOREGOING NEGATION OF DAMAGES IS A FUNDAMENTAL ELEMENT OF THE USE OF THE CONTENTS HEREOF, AND THESE CONTENTS WOULD NOT BE PUBLISHED BY TIA WITHOUT SUCH LIMITATIONS. TIA-504

20、7 i Table of Contents FOREWORD II 1 SCOPE 1 2 NORMATIVE REFERENCES 2 3 DEFINITIONS, ABBREVIATIONS AND ACRONYMS 3 3.1 DEFINITIONS . 3 3.2 ABBREVIATIONS AND ACRONYMS . 3 4 SUBJECTIVE SPEECH QUALITY EVALUATION PROCEDURES . 4 4.1 ANALOG DEVICES 5 4.1.1 Send Level, Noise and Distortion 5 4.1.2 Receive Le

21、vel, Noise and Distortion .6 4.1.3 Acoustic Echo Cancellation Performance During Single-Talk .7 4.1.4 Acoustic Echo Cancellation Performance During Double-Talk .8 4.2 DIGITAL DEVICES. 9 4.2.1 Send Level, Noise and Distortion 9 4.2.2 Receive Level, Noise and Distortion .10 4.2.3 Acoustic Echo Cancell

22、ation Performance During Single-Talk .11 4.2.4 Acoustic Echo Cancellation Performance During Double-Talk .12 ANNEX A (INFORMATIVE) MEAN OPINION SCORE (MOS) INFORMATION . 13 ANNEX B (INFORMATIVE) OBJECTIVE SPEECH QUALITY INFORMATION . 14 A.1 TEST ROOM CRITERIA 14 A.2 SEND SPEECH QUALITY IN THE PRESEN

23、CE OF BACKGROUND NOISE 14 A.3 OBJECTIVE LISTENING QUALITY (MOS-LQO) 14 ANNEX C (INFORMATIVE) BIBLIOGRAPHY . 15 Table of Tables Table B.1 Listening-Quality Scale 13 Table B.2 ITU-T G.107 Table B.1 Provisional Guide for the Relation Between R-value and User Satisfaction 13 TIA-5047 ii FOREWORD (This f

24、oreword is not part of this standard.) This document is a TIA Telecommunications standard produced by Subcommittee TR-41.3 of Committee TR-41. This standard was developed in accordance with TIA procedural guidelines, and represents the consensus position of the Subcommittee, which served as the form

25、ulating group. There are 3 annexes in this Standard. Annex A, Annex B, and Annex C are informative and are not considered part of this Standard. The leadership of the TR-41.3 Performance and Accessibility for Communication Devices Subcommittee (Chair: Don McKinnon, AST) acknowledges the written cont

26、ributions provided by the following individuals in the development of this standard. Organization Representative TIA-5047 AST Technology Labs Don McKinnon Editor CaptionCall Jeff Bullough ISED Canada Jason Nixon Plantronics Allen Woo Whitesell Consulting LLC Steve Whitesell Suggestions for improveme

27、nt of this standard are welcome. They should be sent to: Telecommunications Industry Association Technology and Standards Department Suite 200 1320 North Courthouse Road Arlington, VA 22201 ( http:/www.tiaonline.org ) TIA-5047 1 COMMUNICATIONS PRODUCTS SPEECH QUALITY SUBJECTIVE MEASUREMENT PROCEDURE

28、S AND PERFORMANCE RECOMMENDATIONS 1 SCOPE This standard establishes the speech quality subjective measurement procedures and performance recommendations for analog and digital communications devices. TIA-5047 2 2 NORMATIVE REFERENCES The following standards contain provisions which, through referenc

29、e in this text, constitute provisions of this Standard. At the time of publication, the editions indicated were valid. All standards are subject to revision, and parties to agreements based on this Standard are encouraged to investigate the possibility of applying the most recent editions of the sta

30、ndards indicated below. ANSI and TIA maintain registers of currently valid national standards published by them. 1. ANSI/TIA-470.110-E-2017, Telecommunications - Telephone Terminal Equipment - Transmission Requirements for Analog Telephones with Handsets. 2. ANSI/TIA-470.120-D-2017, Telecommunicatio

31、ns - Telephone Terminal Equipment - Transmission Requirements for Analog Speakerphones. 3. ANSI/TIA-470.130-C-2008 (R2016), Telecommunications - Telephone Terminal Equipment - Transmission Requirements for Analog Telephones with Headsets. 4. ANSI/TIA-920.110-B-2015, Telecommunications - Communicatio

32、ns Products - Transmission Requirements for Digital Interface Communications Devices with Handsets. 5. ANSI/TIA-920.120-B-2017, Telecommunications - Communications Products - Transmission Requirements for Digital Interface Communications Devices with Speakerphone. 6. ANSI/TIA-920.130-B-2017, Telecom

33、munications - Communications Products - Transmission Requirements for Digital Interface Communications Devices with Headsets. 7. IEEE Std 269-2010, IEEE Standard Methods for Measuring Transmission Performance of Analog and Digital Telephone Sets, Handsets, and Headsets. TIA-5047 3 3 DEFINITIONS, ABB

34、REVIATIONS AND ACRONYMS 3.1 DEFINITIONS For the purposes of this standard, the following definitions apply. Objective Global-MOS (G-MOS): The overall quality including speech and background noise Objective Noise-MOS (N-MOS): The transmission quality of the background noise Objective Speech-MOS (S-MO

35、S): The transmission quality of the speech Far-end: Refers to the user who is talking to the user who is using the device under test Near-end: Refers to the user who is using the device under test (DUT) 3.2 ABBREVIATIONS AND ACRONYMS Abbreviations and acronyms, other than in common usage, which appe

36、ar in this standard, are defined below. DUT Device Under Test MOS Mean Opinion Score MOS-LQO Mean Opinion Score Listening Quality Objective PESQ Perceptual Evaluation of Speech Quality POLQA Perceptual Objective Listening Quality Assessment TOSQA Telecommunication Objective Speech Quality Assessment

37、 TIA-5047 4 4 SUBJECTIVE SPEECH QUALITY EVALUATION PROCEDURES As may be recommended in TIA-470.110-E, TIA-470.120-D, TIA-470.130-C, TIA-920.110-B, TIA-920.120-B, TIA-920.123, and TIA-920.130-B, devices may be evaluated subjectively during an active call scenario with the goal to identify any obvious

38、 problems that may have been missed throughout the objective tests. The evaluation should be performed under normal usage conditions and some stress conditions. Normal usage conditions: Moderately sized room. Room ambient noise level: 35-40 dBA. Hoth noise (see IEEE Std 269) generated from a loudspe

39、aker facing a corner of the room can be used to produce this level of noise. Human speech at normal level, typically 90 dBSPL measured approximately 25mm from the mouth. Receive volume control is set to a comfortable listening level as determined per the applicable device specification. Stressed usa

40、ge conditions: Human speech at quiet level, typically 80 dBSPL, and loud level, typically 100 dBSPL, measured approximately 25mm from the mouth. Receive volume control is set to maximum level or maximum tolerable by the tester. Room ambient noise level: 50-55 dBA. Hoth noise generated from a loudspe

41、aker facing a corner of the room can be used to produce this level of noise. Far-end setup conditions: The far-end talker is located in a quiet office environment with a high quality reference corded handset or binaural corded headset. The conformance of this handset or headset to latest version of

42、TIA-470.110-E /TIA-920.110-B or TIA-470.130-C/TIA-920.130-B, respectively, should be verified. The volume setting should match the nominal receive output setting of 76 dBSPL for the handset or 70 dBSPL for the binaural headset. Speech Phrases/Sentences: The following speech may be used to provide a

43、consistent test scenario. Phrase DUT (Near-End) Tester Reference (Far-End) Tester 1 A speedy man can beat this track mark Oak is strong and also gives shade 2 He broke a new shoelace that day Open the crate but dont break the glass 3 The coffee stand is too high for the couch Thieves who rob friends

44、 deserve jail 4 The urge to write short stories is rare The ripe taste of cheese improves with age TIA-5047 5 4.1 ANALOG DEVICES All tests below require two people. The term near-end user describes the person using the DUT and the term far-end user describes the person in a remote room who is using

45、a reference device to communicate with the near-end user. Ideally a controlled end-to-end test scenario uses a network simulation circuit which allows the DUT to be connected to a farend reference device with control over both the farend and the nearend loop conditions, where each side can have a 0

46、km, 2.7 km and 4.6 km test loop to simulate a range of PSTN connections. At a minimum a call using real lines can be used but the lines lengths are uncontrolled. Network simulation: Two CO Simulator circuits with 0 km, 2.7 km and 4.6 km test loops (See TIA-470.110-E) A CO-to-CO Network with the capa

47、bility for 0 dB and 6 dB network loss 4.1.1 Send Level, Noise and Distortion 4.1.1.1 Purpose 1. The send signal level evaluation is performed to verify the DUT output is sufficient when received by the far-end. 2. The send noise evaluation is performed to verify that no excessive noise is transmitte

48、d from the DUT to the far-end listener. It will also verify that there are no disruptive noise level changes, often referred to as “noise pumping.” 3. The send distortion evaluation is performed to verify that, when the near-end user is speaking, the far-end listener does not perceive distortion due

49、 to microphone or electrical clipping of the DUT. 4.1.1.2 Recommendation The DUT send signal should be loud enough for the far-end user to hear comfortably across the range of loop lengths with acceptable noise and distortion characteristics. 4.1.1.3 Evaluation Procedure 1. Under normal noise conditions, the near-end and far-end are connected on a 0 km loop length and 6 dB of network loss. 2. The near-end talker speaks phrases 1-4 in clause 4 with a normal speech level with a silent pause of 2-4 seconds after each phrase