ETSI TR 102 716-1-2009 Speech and multimedia Transmission Quality (STQ) Guidelines objectives and results of speech quality analysis in the context of interworking Plugtests for mu.pdf

1、 ETSI TR 102 716-1 V1.1.1 (2009-07)Technical Report Speech and multimedia Transmission Quality (STQ);Guidelines, objectives and results of speech quality analysisin the context of interworking Plugtestsfor multiplay services;Part 1: Guidelines and objectivesETSI ETSI TR 102 716-1 V1.1.1 (2009-07)2Re

2、ference DTR/STQ-00132-1 Keywords interoperability, quality, voice ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/8

3、8 Important notice Individual copies of the present document can be downloaded from: http:/www.etsi.org The present document may be made available in more than one electronic version or in print. In any case of existing or perceived difference in contents between such versions, the reference version

4、 is the Portable Document Format (PDF). In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status

5、. Information on the current status of this and other ETSI documents is available at http:/portal.etsi.org/tb/status/status.asp If you find errors in the present document, please send your comment to one of the following services: http:/portal.etsi.org/chaircor/ETSI_support.asp Copyright Notificatio

6、n No part may be reproduced except as authorized by written permission. The copyright and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2009. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTM, TIPHONTM, the TIPHON logo and the ETSI logo

7、 are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. LTE is a Trade Mark of ETSI currently being registered for the benefit of its Members and of the 3GPP Organizational P

8、artners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI TR 102 716-1 V1.1.1 (2009-07)3Contents Intellectual Property Rights 4g3Foreword . 4g31 Scope 5g32 References 5g32.1 Normative references . 5g32.2 Informative references 5g33 Abbreviations . 6g34 Cont

9、ext . 7g35 Type of measurement . 7g36 Evaluation chain . 8g36.1 Take into account electro-acoustic characteristics . 8g36.2 Unique evaluation chain implementation . 8g36.3 Evaluation chain description 9g37 Metrics 10g37.1 Post Dialling Delay 10g37.2 Listening speech quality . 10g37.3 End to End dela

10、y 11g37.4 Listening speech quality stability . 11g37.5 Active level of speech signal at reception 12g37.6 Reception noise level 12g37.7 Speech signal attenuation (or gain) after transmission . 12g37.8 Talker Echo Delay 13g37.9 Talker Echo Attenuation 13g37.10 DTMF integrity 13g38 Results reports 14g

11、38.1 Measurement configuration description . 14g38.2 One-view visualization of performances 14g38.3 Visualization of performance variations . 15g38.4 Result interpretations 16g39 Results comments . 16g3History 18g3ETSI ETSI TR 102 716-1 V1.1.1 (2009-07)4Intellectual Property Rights IPRs essential or

12、 potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Esse

13、ntial, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (http:/webapp.etsi.org/IPR/home.asp). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI.

14、 No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Foreword This Technical Report (TR) has been produced by ETSI Technical Committee Speech and

15、multimedia Transmission Quality (STQ). The present document is part 1 of a multi-part deliverable covering Guidelines, objectives and results of speech quality analysis in the context of interworking Plugtests for multiplay services, as identified below: Part 1: “Guidelines and objectives“; Part 2:

16、“Results“. ETSI ETSI TR 102 716-1 V1.1.1 (2009-07)51 Scope The present document provides objectives for speech quality evaluation in the specific context of interoperability event. In this context where acoustic measurements are not possible, is specified the type of measurement chain to be implemen

17、ted and the necessary calibrations. In the present document, are presented a list of metrics that can be assessed and the mode of result presentation. It is also specified comments to be drafted in test reports to clarify the context in which analyses were carried out. 2 References References are ei

18、ther specific (identified by date of publication and/or edition number or version number) or non-specific. For a specific reference, subsequent revisions do not apply. Non-specific reference may be made only to a complete document or a part thereof and only in the following cases: - if it is accepte

19、d that it will be possible to use all future changes of the referenced document for the purposes of the referring document; - for informative references. Referenced documents which are not found to be publicly available in the expected location might be found at http:/docbox.etsi.org/Reference. NOTE

20、: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee their long term validity. 2.1 Normative references The following referenced documents are indispensable for the application of the present document. For dated references, only the edition cited

21、 applies. For non-specific references, the latest edition of the referenced document (including any amendments) applies. Not applicable. 2.2 Informative references The following referenced documents are not essential to the use of the present document but they assist the user with regard to a partic

22、ular subject area. For non-specific references, the latest version of the referenced document (including any amendments) applies. i.1 ETSI EG 202 765-2: “Speech Processing, Transmission and Quality Aspects (STQ); QoS and network performance metrics and measurement methods; Part 2 : Transmission Qual

23、ity Indicator combining Voice Quality Metrics“. i.2 ITU-T Recommendation P.862: “Perceptual evaluation of speech quality (PESQ): An objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs“. i.3 ITU-T Recommendation P.862.1: “Mapping function for

24、transforming P.862 raw result scores to MOS-LQO“. i.4 ITU-T Recommendation P.862.2: “Wideband extension to Recommendation P.862 for the assessment of wideband telephone networks and speech codecs“. ETSI ETSI TR 102 716-1 V1.1.1 (2009-07)6i.5 ITU-T Recommendation P.862.3: “Application guide for objec

25、tive quality measurement based on Recommendations P.862, P.862.1 and P.862.2“. i.6 ITU-T Recommendation P.800: “Methods for subjective determination of transmission quality“. i.7 ITU-T Recommendation P.800.1: “Mean Opinion Score (MOS) terminology“. i.8 ITU-T Recommendation G.114: “One-way transmissi

26、on time“. i.9 ITU-T Recommendation P.56: “Objective measurement of active speech level“. i.10 ITU-T Recommendation O.41: “Psophometer for use on telephone-type circuits“. i.11 ETSI ES 201 970: “Access and Terminals (AT); Public Switched Telephone Network (PSTN); Harmonized specification of physical

27、and electrical characteristics at a 2-wire analogue presented Network Termination Point (NTP)“. i.12 ITU-T Recommendation G.131: “Talker echo and its control“. i.13 ITU-T Recommendation G.168: “Digital network echo cancellers “. i.14 ITU-T Recommendation Q.23: “Technical features of push-button tele

28、phone sets“. i.15 ETSI ES 201 235-1: “Specification of Dual Tone Multi-Frequency (DTMF) Transmitters and Receivers; Part 1: General“. i.16 ETSI ES 201 235-3: “ Access and Terminals (AT); Specification of Dual-Tone Multi-Frequency (DTMF) Transmitters and Receivers; Part 3: Receivers“. i.17 ITU-T Reco

29、mmendation P.505: “One-view visualization of speech quality measurement results“. 3 Abbreviations For the purposes of the present document, the following abbreviations apply: DSLAM Digital Subscriber Line Access Multiplexer DTMF Dual Tone Multi-Frequency GPON Gigabit Passive Optical Network GW GateW

30、ay HomeGW Home GateWay (Referenced also as Residential Gateway) ID IDentification IP Internet Protocol ISDN Integrated Services Digital Network ITU-T International Telecommunication Union - Telecommunication standardization sector MediaGW Media GateWay MOS Mean Opinion Score MOS-LQOM Mean Opinion St

31、ore - Listening Quality Objective Mixed bandwidths PDD Post Dialling Delay PESQ Perceptual Evaluation of Speech Quality PSTN Public Switched Telephone Network TV TeleVision VoD Video on Demand VoIP Voice over Internet Protocol xDSL x Data Subscriber Line (where x represent the different associated t

32、echnologies) ETSI ETSI TR 102 716-1 V1.1.1 (2009-07)74 Context Frequently during Plugtests, speech quality analysis come to complete inter-working tests. It was the case for the different xDSL and GPON Plugtests organized by ETSI at Lannion in 2006, 2007 and 2008. The tests conditions are perfectly

33、adapted to protocol and inter-working analysis: the different participants are located and installed in the same area (very large room). A precise test planning allows several tests of manufacturer equipments in various conditions and configurations. Installing different equipment and expects (manuf

34、acturer and organizer teams) in the same area, makes easier interworking test organization but does not permit at all acoustic measurements. These environments without control of acoustic condition require adaptation of speech quality analysis and evaluation restriction to specific indicators. Figur

35、e 1: Photo presenting a part of the area used for xDSL and GPON interoperability event organized by ETSI at Lannion in June, 2007 Moreover, timeslots fixed to every manufacturer for every test condition are relatively short (1 or 2 hours) to allow performing a maximum of different configurations ana

36、lysis. These relatively short timeslots are also required to restrict speech quality analysis to main parameters such as speech signal distortion after transmission and one way transmission delay. 5 Type of measurement Considering conditions in which these tests are carried out, the speech quality a

37、nalysis should be performed only in electric to electric configuration (analysers connected on electrical interfaces of network). Acoustic conditions are absolutely not controlled in the area where interoperability event take place, the speech quality measurements should be carried out from electric

38、 interfaces like ISDN or analogue accesses of the PSTN, electric accesses of equipment or handset interface of terminal. ETSI ETSI TR 102 716-1 V1.1.1 (2009-07)8Test PlatformDevise under testElectric accessElectric accessAnalyserFigure 2: Overview diagram schematizing the measurement bench to be car

39、ried out The device to be tested is characterized on an electric-electric configuration. 6 Evaluation chain 6.1 Take into account electro-acoustic characteristics Although analyses are carried out from electric interfaces, it is necessary to take into account -during analysis- the transducers (micro

40、phones and loudspeakers) characteristics. This restriction (implementation of electric to electric configuration) requires a pre-calibration of the evaluation chain in acoustic situation. This calibration allows determination of electro-acoustic characterization of transducers, characterization whic

41、h is used to balance measurements performed via electric interfaces. Information concerning the pre-calibration using the electro-acoustic parts of the evaluation chain is available in EG 202 765-2 i.1, annex B. 6.2 Unique evaluation chain implementation The interoperability event context consists i

42、n assessing different equipment industrialized by different manufacturers. Therefore, test conditions consist in carrying out inter-work between 2 (or several) types of equipment, like HomeGW with DSLAM, IPphone with gatekeepers, HomeGW with MediaGW, etc. Test PlatformElectric accessElectric accessD

43、evice1 under test(for example: HomeGW )Device2 under test(for example: DSLA )Figure 3: Overview diagram schematizing a configuration of interfunctioning test In the case presented above, it can be an interfunctioning between a HomeGW and a DSLAM. ETSI ETSI TR 102 716-1 V1.1.1 (2009-07)9In any case,

44、for a given type of validated equipment (HomeGW, IPphone, MediaGW) it is necessary that speech quality evaluation should be performed on the same evaluation chain. This condition allows results and equipment performances comparison. The analyses of speech quality require carrying out a sort of “refe

45、rence platform“ where all equipment has well known characteristics. The reference platform should utilize equipment whose characteristics are well known either because equipment is already deployed in the network or because it is already used in laboratory. The reference platform should not utilize

46、equipment whose characteristics are not well known. In these conditions, the speech quality analysis will be performed on a platform where all the equipment of the chain has perfectly known characteristics except the device concerned by the tests of speech quality. Test PlatformElectric accessElectr

47、ic accessDevice1 under testDevice2 reference unitFigure 4: Overview diagram schematizing the measurement bench to carry out speech quality characterizations on Device 1 (like HomeGW for example) To carry out analysis on Device 1, Device 2 under test is replaced by a reference equipment. With this co

48、nfiguration, any Device 1 going through speech quality analysis will be tested in the same conditions with the same platform. 6.3 Evaluation chain description Besides the fact that the measurement chain should be perfectly controlled with perfectly known characteristics, it is necessary that this ch

49、ain of measure will be described exactly. This requirement allows to know exactly the conditions of analysis and to save the context in which these analyses were conducted. By providing and recording all this information it will be possible (if necessary) to repeat analyses in the same conditions. Concerning the test platform it is necessary to produce: a description of the deployed architecture (equipment and connection between them); a description of every equipment mentioning manufacturer, model, firmware version and so on; a d