ETSI EG 201 377-3-2003 Speech Processing Transmission and Quality Aspects (STQ) Specification and measurement of speech transmission quality Part 3 Non-intrusive objective measurem.pdf

1、 ETSI EG 201 377-3 V1.1.1 (2003-06)ETSI Guide Speech Processing, Transmission and Quality Aspects (STQ);Specification and measurement ofspeech transmission quality;Part 3: Non-intrusive objective measurement methodsapplicable to networks and links with classes of servicesETSI ETSI EG 201 377-3 V1.1.

2、1 (2003-06) 2 Reference DEG/STQ-00026 Keywords interworking, quality, speech, testing, transmission, QoS ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la

3、 Sous-Prfecture de Grasse (06) N 7803/88 Important notice Individual copies of the present document can be downloaded from: http:/www.etsi.org The present document may be made available in more than one electronic version or in print. In any case of existing or perceived difference in contents betwe

4、en such versions, the reference version is the Portable Document Format (PDF). In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be

5、subject to revision or change of status. Information on the current status of this and other ETSI documents is available at http:/portal.etsi.org/tb/status/status.asp If you find errors in the present document, send your comment to: editoretsi.org Copyright Notification No part may be reproduced exc

6、ept as authorized by written permission. The copyright and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2003. All rights reserved. DECTTM, PLUGTESTSTM and UMTSTM are Trade Marks of ETSI registered for the benefit of its Members. TIPHO

7、NTMand the TIPHON logo are Trade Marks currently being registered by ETSI for the benefit of its Members. 3GPPTM is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. ETSI ETSI EG 201 377-3 V1.1.1 (2003-06) 3 Contents Intellectual Property Rights5

8、 Foreword.5 1 Scope 6 2 References 6 3 Definitions and abbreviations.7 3.1 Definitions7 3.2 Abbreviations .8 4 Quick definition and overview of existing methods.9 4.1 Introduction 9 4.2 Non-intrusive methods .10 4.3 Intrusive methods .11 5 Comparison of non-intrusive methods with intrusive methods12

9、 6 Parameters measured in a non-intrusive way and linked to quality of service in networks.13 6.1 Parameters related to transport protocol or signalling13 6.1.1 Originating and terminating address digits (ITU-T Recommendation E.164 and/or IP) 13 6.1.2 Facility or circuit identification 14 6.1.3 Time

10、 and duration of connection and of call 14 6.1.4 Customer identification.14 6.1.5 Connection state14 6.1.6 Data analysis and reports 14 6.1.7 Jitter 14 6.1.8 Packet loss and out of order packet rates 15 6.1.9 RTCP round trip delay15 6.1.10 Type and configuration of codec 16 6.1.11 Quantity of transm

11、itted data16 6.1.12 IP one-way connectivity .16 6.1.13 Packet arrival descriptors16 6.2 Parameters related to the signal analysis 16 6.2.1 Signal classification 16 6.2.2 Active speech level .17 6.2.3 Speech activity factor17 6.2.4 Noise level (psophometric weighting) 17 6.2.5 Noise classification.17

12、 6.2.6 Speech echo path delay.17 6.2.6.1 Single reflections.18 6.2.6.2 Multiple reflections .18 6.2.6.3 Methods of calculating speech echo path delay 18 6.2.7 Attenuation of the echo signal 18 6.2.7.1 Single reflections.18 6.2.7.2 Multiple reflections .18 6.2.8 3 kHz flat noise level 18 6.2.9 Satura

13、tion clipping18 6.2.10 Double talk19 6.2.11 Syllable clipping .19 6.2.12 One-way transmission.19 6.2.13 Crosstalk .19 6.2.14 Stability loss19 6.2.15 Voice Quality and distortion.19 6.2.16 Other degradations20 7 Guidance on how to use measurement results to derive quality of service ratings 20 7.1 Us

14、e of individual thresholds.20 7.2 Use of models.22 ETSI ETSI EG 201 377-3 V1.1.1 (2003-06) 4 7.2.1 E-Model 22 7.2.1.1 The historical model22 7.2.1.2 Links with network planning and classes of service .22 7.2.1.3 Adaption to non-intrusive measurements22 7.2.1.4 Adaption to VoIP 23 7.2.2 CCI (Call Cla

15、rity Index) .23 7.2.3 Other parametric models.24 7.2.4 Impact of the duration and location of speech degradations.25 7.3 Miscellaneous specific usages of non-intrusive measurements25 7.3.1 Detection and characterization of specific defaults 25 7.3.2 Detection of the type of codec 26 7.3.3 Detection

16、of comfort noise .26 7.3.4 Dynamic choice of AMR coding rate and optimization of bandwidth .27 Annex A (informative): Examples of Specific Systems .28 A.1 NiQA (Non-intrusive Quality Assessment)28 A.2 NINA (Non-intrusive Network Assessment) .29 A.3 PSOM (Perceptual Single-ended Objective Measure) .3

17、0 Annex B (informative): Bibliography.31 History 32 ETSI ETSI EG 201 377-3 V1.1.1 (2003-06) 5 Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available

18、 for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (h

19、ttp:/webapp.etsi.org/IPR/home.asp). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or

20、may become, essential to the present document. Foreword This ETSI Guide (EG) has been produced by ETSI Technical Committee Speech Processing, Transmission and Quality Aspects (STQ). The present document is part 3 of a multi-part deliverable covering the specification and measurement of speech transm

21、ission quality, as identified below: Part 1: “Introduction to objective comparison measurement methods for one-way speech quality across networks“; Part 2: “Mouth-to-ear speech transmission quality including terminals“; Part 3: “Non-intrusive objective measurement methods applicable to networks and

22、links with classes of services“. ETSI ETSI EG 201 377-3 V1.1.1 (2003-06) 6 1 Scope The present document is part 3 of a series of documents on the specification and measurement of mouth-to-ear (also end-to-end) speech transmission quality. Its main objective is to describe objective non-intrusive met

23、hods and systems for measuring speech quality in networks and to present the links between the results of such methods and the perceived quality of voice services. The present document gives an overview of the non-intrusive methods available for measuring speech transmission quality. It applies only

24、 for narrowband (i.e. between 300 Hz and 3 400 Hz) communications, assumed between handset terminals. Its purpose is to give information and guidance primarily for operators, users, consumer organizations and regulators who wish to measure or compare the speech transmission quality provided by diffe

25、rent networks. The present document applies to both fixed and mobile, circuit switched or packet-based networks (including IP and ATM based networks), i.e. no specific measurement interface is needed to apply those measurement methods on networks. 2 References The following documents contain provisi

26、ons which, through reference in this text, constitute provisions of the present document. References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For a specific reference, subsequent revisions do not apply. For a non-specific refere

27、nce, the latest version applies. Referenced documents which are not found to be publicly available in the expected location might be found at http:/docbox.etsi.org/Reference. 1 ETSI ETR 250 (1996): “Transmission and Multiplexing (TM); Speech communication quality from mouth to ear for 3,1 kHz handse

28、t telephony across networks“. 2 ETSI EG 201 050 (1999): “Speech Processing, Transmission and Quality Aspects (STQ); Overall Transmission Plan Aspects for Telephony in a Private Network“. 3 ETSI TS 101 329-5 (2002): “Telecommunications and Internet Protocol Harmonization Over Networks (TIPHON) Releas

29、e 3; End-to-end Quality of Service in TIPHON systems; Part 5: Quality of Service (QoS) measurement methodologies“. 4 ITU-T Recommendation E.164 (1997): “The international public telecommunication numbering plan“. 5 ITU-T Recommendation G.107 (2002): “The E-Model, a computational model for use in tra

30、nsmission planning“. 6 ITU-T Recommendation G.108 (1999): “Application of the E-model: A planning guide“. 7 ITU-T Recommendation G.109 (1999): “Definition of categories of speech transmission quality“. 8 ITU-T Recommendation G.122 (1993): “Influence of national systems on stability and talker echo i

31、n international connections“. 9 ITU-T Recommendation G.212 (1988): “Hypothetical reference circuits for analogue systems“. 10 ITU-T Recommendation G.223 (1988): “Assumptions for the calculation of noise on hypothetical reference circuits for telephony“. 11 ITU-T Recommendation G.763 (1998): “Digital

32、 circuit multiplication equipment using G.726 ADPCM and digital speech interpolation“. ETSI ETSI EG 201 377-3 V1.1.1 (2003-06) 7 12 ITU-T Recommendation O.41 (1994): “Psophometer for use on telephone-type circuits“. 13 ITU-T Recommendation P.56 (1993): “Objective measurement of active speech level“.

33、 14 ITU-T Recommendation P.561 (2002): “In-service non-intrusive measurement device - Voice service measurements“. 15 ITU-T Recommendation P.562 (2000): “Analysis and interpretation of INMD voice-services measurements“. 16 ITU-T Recommendation P.862 (2001): “Perceptual evaluation of speech quality (

34、PESQ), an objective method for end-to-end speech quality assessment of narrowband telephone networks and speech codecs“. 17 ITU-T Recommendation Y.1540 (2002): “Internet protocol data communication service - IP packet transfer and availability performance parameters“. 18 IEEE 743: “IEEE Standard Equ

35、ipment Requirements and Measurement Techniques for Analog Transmission Parameters for Telecommunications“. 19 IETF RFC 1889: “RTP: A Transport Protocol for Real-Time Applications“ Audio-Video Transport Working Group, H. Schulzrinne, S. Casner, R. Frederick, V. Jacobson. January 1996. 20 IETF RFC 267

36、8: “IPPM Metrics for Measuring Connectivity“ J. Mahdavi, V. Paxson. September 1999. 21 IETF RFC 2680: “A One-way Packet Loss Metric for IPPM“ G. Almes, S. Kalidindi, M. Zekauskas. September 1999. 22 ETSI EG 201 377-1: “Speech Processing, Transmission and Quality Aspects (STQ); Specification and meas

37、urement of speech transmission quality; Part 1: Introduction to objective comparison measurement methods for one-way speech quality across networks“. 3 Definitions and abbreviations 3.1 Definitions For the purposes of the present document, the following terms and definitions apply: bark: frequency u

38、nit in the perceptual domain; e.g. frequencies at 3, 4 and 5 Bark are perceived as equally-spaced cepstrum: cepstrum of a signal is defined as the inverse Fourier transform of the logarithm of the power spectrum of that signal NOTE: Linear distortions of a signal (e.g. delay, echo) are additive in t

39、he cepstral domain. cognitive: pertaining to higher layers of human reception; e.g. interpretation of speech perceptual: pertaining to lower layers of human reception; e.g. processing of sound signals psycho-acoustic: pertaining to acoustic processing particular to the human sound perception system;

40、 e.g. masking of adjacent frequency components ETSI ETSI EG 201 377-3 V1.1.1 (2003-06) 8 3.2 Abbreviations For the purposes of the present document, the following abbreviations apply: AMR Adaptive Multi Rate codec ANSI American National Standards Institute CCI Call Clarity Index DC Direct Current DC

41、ME Digital Circuit Multiplication Equipment DTX Discontinuous Transmission EFR Enhanced Full Rate ETR ETSI Technical Report ETSI European Telecommunications Standards Institute FR Full Rate GPRS General Packet Radio Service GPS Global Positioning SystemGSM Global System for Mobile communications (or

42、iginally French - Groupe Spcial Mobile) IEEE Institute of Electrical and Electronics Engineers IETF Internet Engineering Task Force INMD In-service Non-intrusive Measurement Device IP Internet Protocol ISDN Integrated Services Digital Network ITU(-T) International Telecommunications Union (Telecommu

43、nication standardization Sector) MOS Mean Opinion Score NINA Non-Intrusive Network Assessment NiQA Non-intrusive Quality Assessment PCM Pulse Code Modulation PESQ Perceptual Evaluation of Speech Quality PSOM Perceptual Single-ended Objective Measure PSTN Public Switched Telephone Network RFC Request

44、 For Comment RLR Receiving Loudness Rating RR Receiver Report RRM Radio Resource Management RTCP Real-time Transport Control Protocol RTP Real-time Transport Protocol SLA Service Level Agreement SLR Sending Loudness Rating SR Sender Report TDM Time Division Multiplexing TS ETSI Technical Specificati

45、onUDP User Datagram Protocol VAD Voice Activity Detector VoIP Voice over the Internet Protocol VTQM-E Voice Transmission Quality from Mouth to Ear ETSI ETSI EG 201 377-3 V1.1.1 (2003-06) 9 4 Quick definition and overview of existing methods 4.1 Introduction In order to measure speech transmission qu

46、ality on a regular basis, it is necessary to avoid the complicated and expensive procedure of subjective determination, and to use objective systems instead. Today there are several systems and methods in use, some of which are in a rather experimental state, while others are commercially available

47、products. The following non-exhaustive list shows some situations related to transmission over networks where such objective measurement methods are being applied: Mobile Communications: In mobile communication systems (e.g. GSM), speech quality measurement campaigns can unveil coverage problems, ba

48、se station failures (e.g. handover problems), etc. Speech compression devices: In networks with speech compression devices (e.g. codecs, DCME), speech quality can be severely impacted due to the interaction of such devices with each other and with effects like noise, echoes, etc. Monitoring mouth-to

49、-ear speech quality can detect such problems. Voice over IP: The characteristics of packet-based networks (including IP) are different from switched networks. For voice over IP, the most critical parameters are delay and the degree of packet loss. Monitoring speech quality can help to improve service quality. In order to do so, however, objective methods shall be able to cope with such impairments. Cascade of networks and/or analogue interfaces: In todays liberalized environment, it is increasingly likely that a call i