ITU-T P 840-2003 Subjective listening test method for evaluating circuit multiplication equipment SERIES P TELEPHONE TRANSMISSION QUALITY TELEPHONE INSTALLATIONS LOCAL LINE NETWORKm.pdf

1、 INTERNATIONAL TELECOMMUNICATION UNION ITU-T P.840TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU (11/2003) SERIES P: TELEPHONE TRANSMISSION QUALITY, TELEPHONE INSTALLATIONS, LOCAL LINE NETWORKS Methods for objective and subjective assessment of quality Subjective listening test method for evaluatin

2、g circuit multiplication equipment ITU-T Recommendation P.840 ITU-T P-SERIES RECOMMENDATIONS TELEPHONE TRANSMISSION QUALITY, TELEPHONE INSTALLATIONS, LOCAL LINE NETWORKS Vocabulary and effects of transmission parameters on customer opinion of transmission quality Series P.10 Subscribers lines and se

3、ts Series P.30 P.300 Transmission standards Series P.40 Objective measuring apparatus Series P.50 P.500 Objective electro-acoustical measurements Series P.60 Measurements related to speech loudness Series P.70 Methods for objective and subjective assessment of quality Series P.80 P.800 Audiovisual q

4、uality in multimedia services Series P.900 For further details, please refer to the list of ITU-T Recommendations. ITU-T Rec. P.840 (11/2003) i ITU-T Recommendation P.840 Subjective listening test method for evaluating circuit multiplication equipment Summary This Recommendation describes a subjecti

5、ve listening test method which can be used to evaluate the speech quality of Circuit Multiplication Equipment (CME). It is intended for use with CME systems, such as those described in ITU-T Recs G.763, G.767, G.768 (DCME), G.765 (PCME) and G.769/Y.1242 (IP-CME) which use digital speech interpolatio

6、n (DSI) techniques. In this version, the scope is expended to more recent speech coders implemented in CME. Updating the Recommendation includes tandemming situations and comfort noise test configuration. The new Appendix I gives guidance for conversation tests. Source ITU-T Recommendation P.840 was

7、 approved by ITU-T Study Group 12 (2001-2004) under the ITU-T Recommendation A.8 procedure on 13 November 2003. ii ITU-T Rec. P.840 (11/2003) FOREWORD The International Telecommunication Union (ITU) is the United Nations specialized agency in the field of telecommunications. The ITU Telecommunicatio

8、n Standardization Sector (ITU-T) is a permanent organ of ITU. ITU-T is responsible for studying technical, operating and tariff questions and issuing Recommendations on them with a view to standardizing telecommunications on a worldwide basis. The World Telecommunication Standardization Assembly (WT

9、SA), which meets every four years, establishes the topics for study by the ITU-T study groups which, in turn, produce Recommendations on these topics. The approval of ITU-T Recommendations is covered by the procedure laid down in WTSA Resolution 1. In some areas of information technology which fall

10、within ITU-Ts purview, the necessary standards are prepared on a collaborative basis with ISO and IEC. NOTE In this Recommendation, the expression “Administration“ is used for conciseness to indicate both a telecommunication administration and a recognized operating agency. Compliance with this Reco

11、mmendation is voluntary. However, the Recommendation may contain certain mandatory provisions (to ensure e.g. interoperability or applicability) and compliance with the Recommendation is achieved when all of these mandatory provisions are met. The words “shall“ or some other obligatory language such

12、 as “must“ and the negative equivalents are used to express requirements. The use of such words does not suggest that compliance with the Recommendation is required of any party. INTELLECTUAL PROPERTY RIGHTS ITU draws attention to the possibility that the practice or implementation of this Recommend

13、ation may involve the use of a claimed Intellectual Property Right. ITU takes no position concerning the evidence, validity or applicability of claimed Intellectual Property Rights, whether asserted by ITU members or others outside of the Recommendation development process. As of the date of approva

14、l of this Recommendation, ITU had not received notice of intellectual property, protected by patents, which may be required to implement this Recommendation. However, implementors are cautioned that this may not represent the latest information and are therefore strongly urged to consult the TSB pat

15、ent database. ITU 2004 All rights reserved. No part of this publication may be reproduced, by any means whatsoever, without the prior written permission of ITU. ITU-T Rec. P.840 (11/2003) iii CONTENTS Page 1 Scope 1 1.1 Purpose . 1 1.2 Test philosophy 1 2 References. 2 3 Definitions 3 4 Abbreviation

16、s 3 5 Source recordings . 4 5.1 Apparatus and environment 4 5.2 Speech material 4 5.3 Procedure 5 5.4 Calibration signals and speech levels. 6 6 Simulating system load. 6 6.1 Requirements for a generic voice load simulator . 6 6.2 Determining load capacity of tested systems . 7 6.3 Controlling load

17、applied to tested systems. 8 7 Processing of the speech. 8 8 Test design 9 8.1 Test No. 1 Effect of applied load. 9 8.2 Test No. 2 Effect of digital errors in the DCME control channel . 11 9 Listening test procedure 12 10 Analysis of results 12 Annex A Description of circuit multiplication equipment

18、 12 A.1 Definitions 12 A.2 Digital Speech Interpolation (DSI). 15 A.3 Speech detection. 16 A.4 CME load 16 A.5 Overload strategies . 17 A.6 Silence reconstruction methods 19 A.7 Circuit versus packet mode 19 A.8 Packet reconstruction 20 Annex B Speech material used to construct speech sequences 20 A

19、nnex C Instructions on the use of a limited number of sentences 22 Appendix I Guidance for conversation tests. 22 ITU-T Rec. P.840 (11/2003) 1 ITU-T Recommendation P.840 Subjective listening test method for evaluating circuit multiplication equipment11 Scope 1.1 Purpose The purpose of this Recommend

20、ation is to describe a subjective listening test method which can be used to evaluate the speech quality of Circuit Multiplication Equipment (CME). It is intended for use with CME systems, such as those described in ITU-T Recs G.763, G.764, G.765, G.767, G.768 or as described in G.769/Y.1242, which

21、use digital speech interpolation (DSI) techniques. For subjective test evaluations of CME systems not using digital speech interpolation techniques, channel transcoder systems described in ITU-T Rec. G.761 (General characteristics of a 60-channel transcoder equipment) or ITU-T Rec. G.762 (General ch

22、aracteristics of a 48-channel transcoder equipment), use ITU-T Rec. P.830. In addition to the listening tests described here, conversational tests are also recommended in order to thoroughly assess the combined effects of delay, echo, non-linearities, etc. Appendix I gives some guidance for conversa

23、tion tests. For CME systems, degradations can include not only the effects of variable bit-rate coding, DSI gain (channel allocation), clipping, freezeout and noise contrast, but also those due to non-linearities in the speech detection system, such that the system may function differently for diffe

24、rent speech input levels or activity factors. It may, therefore, be useful to perform additional tests such as those provided by ITU-T Rec. P.831. Listening tests play an important preliminary role in the assessment, and can supply useful information service to narrow the range of conditions needing

25、 a complete conversation test. This listening test method will not provide results for generating network application rules. Future improvements of the test will allow such results to be obtained. Evaluation of CME in tandem with other CME is considered in this revised version, but some effects of s

26、ystems using encoding at different rates need to be completed. This Recommendation will subsequently be updated when information on these specific points becomes available. 1.2 Test philosophy In order for a test to satisfactorily evaluate CME performance, the test methodology should meet certain co

27、nditions. These are as follows: i) the method should use principles, procedures, and instrumentation that are acceptable to ITU-T; ii) the method should be adaptable to different languages and should yield results that are comparable to those from other tests performed using this Recommendation; iii

28、) the method should permit CME performance to be compared subjectively (or objectively) to reference conditions. Examples of suitable reference conditions are hypothetical reference connections (HRCs), white noise and speech correlated noise. The HRCs should model the facilities the CME is designed

29、to replace, when these facilities are known. The results of the comparisons should permit making “equivalence statements“ about the CME, _ 1The specifications in this Recommendation are subject to future enhancements and, therefore, should be regarded as provisional. 2 ITU-T Rec. P.840 (11/2003) e.g

30、., a CME system is subjectively equivalent to x asynchronously tandemed 64 kbit/s PCM systems. Ideally, the method should yield results from which a network application rule can be derived; iv) the CME should be tested with a realistic load simulator and circuit-under-test signal conditions applied.

31、 Most of the transitory impairments arise when the CME is operating in the range of applied load which forces the use of DSI. Therefore, to subjectively measure the effects of these impairments, it is necessary to vary the applied load on the CME up to and marginally beyond the maximum design load.

32、The clipping produced by the speech detector is affected by the type of signal being transmitted on the circuit under test. Therefore, only a realistic speech signal which also contains appropriate additive noise should be used on the circuit under test; v) the methodology should, ideally, yield res

33、ults which can be used to produce new opinion models or modify existing models. 2 References The following ITU-T Recommendations and other references contain provisions which, through reference in this text, constitute provisions of this Recommendation. At the time of publication, the editions indic

34、ated were valid. All Recommendations and other references are subject to revision; users of this Recommendation are therefore encouraged to investigate the possibility of applying the most recent edition of the Recommendations and other references listed below. A list of the currently valid ITU-T Re

35、commendations is regularly published. The reference to a document within this Recommendation does not give it, as a stand-alone document, the status of a Recommendation. ITU-T Recommendation G.703 (2001), Physical/electrical characteristics of hierarchical digital interfaces. ITU-T Recommendation G.

36、704 (1998), Synchronous frame structures used at 1544, 6312, 2048, 8448 and 44 736 kbit/s hierarchical levels. ITU-T Recommendation G.711 (1988), Pulse code modulation (PCM) of voice frequencies. ITU-T Recommendation G.726 (1990), 40, 32, 24, 16 kbit/s Adaptive Differential Pulse Code Modulation (AD

37、PCM). ITU-T Recommendation G.728 (1992), Coding of speech at 16 kbit/s using low-delay code excited linear prediction. ITU-T Recommendation G.729 (1996), Coding of speech at 8 kbit/s using conjugate-structure algebraic-code-excited linear-prediction (CS-ACELP). ITU-T Recommendation G.732 (1988), Cha

38、racteristics of primary PCM multiplex operating at 2048 kbit/s. ITU-T Recommendation G.733 (1988), Characteristics of primary PCM multiplex operating at 1544 kbit/s. ITU-T Recommendation G.761 (1988), General characteristics of a 60-channel transcoder equipment. ITU-T Recommendation G.762 (1988), Ge

39、neral characteristics of a 48-channel transcoder equipment. ITU-T Recommendation G.763 (1998), Digital circuit multiplication equipment using G.726 ADPCM and digital speech interpolation. ITU-T Recommendation G.764 (1990), Voice packetization Packetized voice protocols. ITU-T Recommendation G.765 (1

40、992), Packet circuit multiplication equipment. ITU-T Rec. P.840 (11/2003) 3 ITU-T Recommendation G.767 (1998), Digital circuit multiplication equipment using 16 kbit/s LD-CELP, digital speech interpolation and facsimile demodulation/remodulation. ITU-T Recommendation G.768 (2001), Digital circuit mu

41、ltiplication equipment using 8 kbit/s CS-ACELP. ITU-T Recommendation G.769/Y.1242 (2002), Circuit multiplication equipment optimized for IP-based networks. ITU-T Recommendation P.50 (1999), Artificial voices. ITU-T Recommendation P.59 (1993), Artificial conversational speech. ITU-T Recommendation P.

42、800 (1996), Methods for subjective determination of transmission quality. ITU-T Recommendation P.810 (1996), Modulated noise reference unit (MNRU). ITU-T Recommendation P.830 (1996), Subjective performance assessment of telephone-band and wideband digital codecs. ITU-T Recommendation P.831 (1998), S

43、ubjective performance evaluation of network echo cancellers. 3 Definitions This Recommendation defines the following term: 3.1 Q: The ratio, in dB, of speech power to modulated noise power in the Modulated Noise Reference Unit, as described in ITU-T Rec. P.810. 4 Abbreviations This Recommendation us

44、es the following abbreviations: A/D Analogue-to-Digital ADPCM Adaptive Differential Pulse Code Modulation BC Bearer Channel CME Circuit Multiplication Equipment CMS Circuit Multiplication System CUT Circuit Under Test D/A Digital-to-Analogue DCME Digital Circuit Multiplication Equipment DCMS Digital

45、 Circuit Multiplication System DLC Dynamic Load Control DSI Digital Speech Interpolation FIFO First-In First-Out HRC Hypothetical Reference Connection ICN Ideal Circuit Noise IP-CME Circuit Multiplication Equipment optimized for IP-based network IRS Intermediate Reference System 4 ITU-T Rec. P.840 (

46、11/2003) ISDN Integrated Services Digital Network LRE Low Rate Encoding MNRU Modulated Noise Reference Unit (ITU-T Rec. P.810) MOS Mean Opinion Score PCM Pulse Code Modulation SNR Signal-to-Noise Ratio STMR SideTone Masking Rating VBR Variable Bit Rate VLS Voice Load Simulator 5 Source recordings 5.

47、1 Apparatus and environment See B.1.1/P.800 through B.1.3/P.800. 5.2 Speech material The format of the speech material must be suitable for the opinion scale being used in the test. This will normally be the listening-quality scale, but optionally the listening-effort scale will be used (see clause

48、8). When the listening-quality scale is used, the following requirements apply: i) The speech material should consist of short passages (called segments), chosen at random (from current non-technical literature or newspapers, for example), easy to understand, and more or less self-contained in meani

49、ng. ii) Each segment when spoken naturally should have a duration of not less than 9 seconds and not more than 11 seconds. iii) Each segment should consist of at least three “sentences“ in a broad sense, that is, parts that can naturally be separated by pauses in speaking, but connected in meaning to what precedes and follows within the segment. iv) Within each segment there should be at least one pause which naturally, in view of the meaning and structure of the text, would last for 1 to 2 seconds. The other pau