1、 ETSI TS 102 024-5 V4.1.1 (2003-09)Technical Specification Telecommunications and Internet ProtocolHarmonization Over Networks (TIPHON) Release 4;End-to-end Quality of Service in TIPHON Systems;Part 5: Quality of Service (QoS) measurement methodologiesETSI ETSI TS 102 024-5 V4.1.1 (2003-09) 2 Refere
2、nce DTS/TIPHON-05008R4 Keywords IP, methodology, quality, service, telephony, QoS, voice ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture
3、de Grasse (06) N 7803/88 Important notice Individual copies of the present document can be downloaded from: http:/www.etsi.org The present document may be made available in more than one electronic version or in print. In any case of existing or perceived difference in contents between such versions
4、, the reference version is the Portable Document Format (PDF). In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revis
5、ion or change of status. Information on the current status of this and other ETSI documents is available at http:/portal.etsi.org/tb/status/status.asp If you find errors in the present document, send your comment to: editoretsi.org Copyright Notification No part may be reproduced except as authorize
6、d by written permission. The copyright and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2003. All rights reserved. DECTTM, PLUGTESTSTM and UMTSTM are Trade Marks of ETSI registered for the benefit of its Members. TIPHONTMand the TIPHO
7、N logo are Trade Marks currently being registered by ETSI for the benefit of its Members. 3GPPTM is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. ETSI ETSI TS 102 024-5 V4.1.1 (2003-09) 3 Contents Intellectual Property Rights5 Foreword.5 1 Sc
8、ope 6 2 References 6 3 Definitions, symbols and abbreviations .8 3.1 Definitions8 3.2 Symbols8 3.3 Abbreviations .8 4 Test Set-up for Terminals and Systems Including Terminals 9 5 Call Establishment Measurements .9 5.1 Start Dial Signal Delay.9 5.2 Post Dial Delay.9 5.3 Call Duration10 5.4 Release o
9、n Request.10 6 Speech Quality Measurements .10 6.1 Subjective Speech Quality10 6.2 Objective Speech Quality.11 6.3 Advanced Objective Speech Quality Parameters .11 6.4 Mean One Way Delay 12 6.5 Echo Path Loss .12 6.6 Loudness Ratings .12 6.7 Overall Transmission Quality Rating R.13 7 Transport layer
10、 measurements13 7.1 One way transmission time 13 7.2 Roundtrip transmission time.13 7.3 2 Point packet delay variation 14 7.4 1 Point packet delay variation 14 7.5 Network packet loss .14 7.6 Effective packet loss.14 7.7 Packet errors.15 7.8 Mis-sequenced packets.15 7.9 Voice client induced PDV15 7.
11、10 Packet loss correlation15 8 QoS mechanism tests16 8.1 Simulated media for QoS calibration .16 8.2 Passive media path monitoring for QoS .16 Annex A (normative): Call establishment measurements.17 Annex B (normative): Speech quality measurements .18 B.1 Delay measurement 18 B.2 Loudness rating 19
12、Annex C (normative): QoS mechanism tests20 C.1 Simulated media for QoS calibration .20 Annex D (normative): Testing procedures for TIPHON terminals and systems23 D.1 Introduction 23 D.2 Parameters, defining speech transmission quality including terminals23 ETSI ETSI TS 102 024-5 V4.1.1 (2003-09) 4 D
13、.3 Test set-up for terminals and systems including terminals 24 D.3.1 Test Signals 24 D.4 Measurement of standard parameters.24 D.5 Advanced Measurements, Taking Into Account the Conversational Situation25 D.5.1 Measurement set-up for objective tests 27 D.5.2 Practical realization of test signals .2
14、7 D.5.3 Test procedures 27 Annex E (informative): Method for determining an equipment impairment factor using passive monitoring 28 E.1 Introduction 28 E.2 Passive QoS Monitor Framework 28 E.3 Determining equipment impairment factor for packet loss29 E.4 Determining Equipment Impairment Factor for P
15、acket Delay Variation.31 E.5 Measuring Delay 32 E.6 Determining Equipment Impairment Factor for CODEC 32 E.7 Determining Overall Equipment Impairment Factor .32 E.7.1 Determining Average Equipment Impairment Factor 32 E.7.2 Recency Effect .33 E.8 Use of the E Model.33 Annex F (informative): Bibliogr
16、aphy .34 History 35 ETSI ETSI TS 102 024-5 V4.1.1 (2003-09) 5 Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-member
17、s, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (http:/webapp.etsi.org/IPR/home.as
18、p). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the pre
19、sent document. Foreword This Technical Specification (TS) has been produced by ETSI Project Telecommunications and Internet Protocol Harmonization Over Networks (TIPHON). The present document is part 5 of a multi-part deliverable covering end-to-end Quality of Service in TIPHON systems, as identifie
20、d below: TR 102 024-1: “General aspects of Quality of Service (QoS)“; TS 102 024-2: “Definition of Speech Quality of Service (QoS) Classes“; TS 102 024-3: “Signalling and Control of end-to-end Quality of Service“; TS 102 024-4: “Quality of Service Management“ TS 102 024-5: “Quality of Service (QoS)
21、measurement methodologies“; TR 102 024-6: “Actual measurements of network and terminal characteristics and performance parameters in TIPHON networks and their influence on voice quality“; TR 102 024-7: “Design guide for elements of a TIPHON connection from an end-to-end speech transmission performan
22、ce point of view“. Part 8: Void. TS 102 024-9: “Call performance Classification (Voice)“. Part 10: To be published as part of release 5 (see note) “QoS Requirements for TIPHON Terminals“; Part 11: To be published as part of release 5 (see note) “Domain by domain performance planning guidelines for e
23、nd-to-end QoS objectives associated with TIPHON speech QoS classes“. TS 102 024-12: “IP Telephony Service Availability“. NOTE: Quality of Service aspects of TIPHON Release 5 systems will be covered in TS 102 025 (see bibliography), and more comprehensive versions of the Release 4 documents listed ab
24、ove will be published as part of Release 5 as work progresses. ETSI ETSI TS 102 024-5 V4.1.1 (2003-09) 6 1 Scope The present document applies to IP networks that provide voice telephony in accordance with any of the TIPHON scenarios. It contains: - test methodologies for end to end QoS parameters; -
25、 test methodologies for network performance parameters. It should be noted that the work has tried to reference already developed measurement techniques rather than defining new techniques unnecessarily. Background information and discussions are contained in the General Aspects of QoS document TR 1
26、02 024-1 1. 2 References The following documents contain provisions which, through reference in this text, constitute provisions of the present document. References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For a specific referen
27、ce, subsequent revisions do not apply. For a non-specific reference, the latest version applies. Referenced documents which are not found to be publicly available in the expected location might be found at http:/docbox.etsi.org/Reference. 1 ETSI TR 102 024-1: “Telecommunications and Internet Protoco
28、l Harmonization Over Networks (TIPHON) Release 4; End to End Quality of Service in TIPHON Systems; Part 1: General aspects of Quality of Service (QoS)“. 2 ITU-T Recommendation P.800: “Methods for subjective determination of transmission quality“. 3 ITU-T Recommendation G.131: “Control of talker echo
29、“. 4 Draft ITU-T Recommendation P.861: “Perceptual Evaluation of Speech Quality (PESQ), an objective method for end-to-end speech quality assessment of narrowband telephone networks and speech codecs“. 5 ITU-T Recommendation G.169: “Automatic level control devices“. 6 ITU-T Recommendation P.340: “Tr
30、ansmission characteristics of hands-free telephones“. 7 ITU-T Recommendation P.76: “Determination of loudness ratings; fundamental principles“. 8 ITU-T Recommendation P.79: “Calculation of Loudness Ratings for telephone sets“. 9 ITU-T Recommendation G.107: “The E-Model, a computational model for use
31、 in transmission planning“. 10 ITU-T Recommendation G.108: “Application of the E-model: A planning guide“. 11 ITU-T Recommendation G.177: “Transmission planning for voice-band services over hybrid Internet/PSTN connections“. 12 ITU-T Recommendation P.59: “Artificial conversational speech“. 13 ITU-T
32、Recommendation P.501: “Test signals for use in telephonometry“. ETSI ETSI TS 102 024-5 V4.1.1 (2003-09) 7 14 ITU-T Recommendation P.502: “Objective test methods for speech communication systems, using complex test signals“. 15 ITU-T Recommendation P.581: “Use of head and torso simulator (HATS) for h
33、ands-free terminal testing“. 16 ITU-T Recommendation P.831: “Subjective performance evaluation of network echo cancellers“. 17 ITU-T Recommendation P.832: “Subjective performance evaluation of Hands-free Terminals“. 18 ITU-T Recommendation P.51: “Artificial mouths“. 19 ITU-T Recommendation P.57: “Ar
34、tificial ears“. 20 ITU-T Recommendation P.58: “Head and torso simulator for telephonometry“. 21 ITU-T Recommendation P.64: “Determination of sensitivity/frequency characteristics of local telephone systems“. 22 ITU-T Recommendation P.50: “Artificial Voices“. 23 ETSI TBR 8: “Integrated Services Digit
35、al Network (ISDN); Telephony 3,1 kHz teleservice; Attachment requirements for handset terminals“. 24 ITU-T Contribution COM12-42 Federal Republic of Germany: “Listening only test results for hands-free telephones and their dependence upon room surroundings (1997)“. 25 ITU-T Recommendation G.711: “Pu
36、lse code modulation (PCM) of voice frequencies“. 26 ITU-T Recommendation G.726: “40, 32, 24, 16 kbit/s Adaptive Differential Pulse Code Modulation (ADPCM)“. 27 ITU-T Recommendation G.113 Appendix 1: “Transmission Impairments - Appendix I: Provisional planning values for the equipment impairment fact
37、or Ie“. 28 ITU-T Recommendation G.114: “One-way transmission time“. 29 ITU-T Contribution COM12-D139 France Tlcom R - percentage of calls with no dial tone. Comments None. 5.2 Post Dial Delay Definition Time in milliseconds between dialling the last digit and an audible tone being heard at the origi
38、nating end. The audible tone is typically ring-back or the engaged tone. ETSI ETSI TS 102 024-5 V4.1.1 (2003-09) 10Test Metrics - post dial delay/ms. Comments Some systems have shown to present the user with a ring-back tone before a connection has been established, this gives the impression that th
39、e PDD is low. If the connection fails this is later switched to an engaged tone. This is unacceptable operation and should be tested. 5.3 Call Duration Definition The time in seconds between bi-directional media path establishment and media path closure at both ends of the connection. Test Metrics -
40、 Call duration/s (accurate to 1 ms); - Percentage of premature releases. Comments The call duration information can be used to check billing system accuracy. 5.4 Release on Request Definition Check to identify that connection is released when placing phone on-hook. Test Metrics - Percentage of corre
41、ctly terminated calls. Comments None. 6 Speech Quality Measurements 6.1 Subjective Speech Quality Definition A subjective quality measure, or Mean Opinion Score (MOS), is determined from performing a subjective test in accordance with P.800 2. A MOS is an average opinion of quality for a system base
42、d on asking people their opinion of quality under control conditions. Further evaluation procedures specifically for echo canceller and hands-free terminal testing can be found in ITU-T Recommendations P.831 16 and P.832 17. Test Metrics - Listening quality absolute category rating (P.800 2, annex B
43、); - Listening distortion category rating (P.800 2, annex D). ETSI ETSI TS 102 024-5 V4.1.1 (2003-09) 11Comments A subjective test, for TIPHON QoS class classification, should include the following reference conditions: - Clean speech; - G.711 25 with no additional distortions; - G.726 26 at 32 kbit
44、/s with no additional distortions; - GSM FR with no additional distortions; - MNRU conditions (Q = 6, 12, 24 and 30). 6.2 Objective Speech Quality Definition A measure of speech quality by a computer based software program. The ETSI TIPHON project endorses the ITU-T Recommendation P.861 4. Test Metr
45、ics - Speech Quality MOS prediction (ITU-T Recommendation P.861 4). Comments It is paramount to use an appropriate speech or speech-like test signal. The signal should be at least 8 to 10 seconds in duration to ensure both system stability and the opportunity for errors to be assessed. 6.3 Advanced
46、Objective Speech Quality Parameters Definition Various measures of speech quality parameters based on test signals and procedures are described in ITU-T Recommendations P.501 13, P.502 14 and P.340 6. Test Metrics - Convergence parameters of echo cancellers (section 4 of ITU-T Recommendation P.502 1
47、4); - Speech quality parameters during double talk (section 5 of ITU-T Recommendation P.502 14); - Companding and AGC characteristics (section 6 of ITU-T Recommendation P.502 14); - Quality of background noise transmission (section 7 of ITU-T Recommendation P.502 14); - Switching parameters (section
48、 8 of ITU-T Recommendation P.502 14). Comments The tests require various (speech-like) test signals as described in ITU-T Recommendation P.501 13 and ITU-T Recommendation P.50 22. The test duration should be at least 8 seconds to 10 seconds in duration to ensure both system stability and the opportu
49、nity for errors to be assessed. In addition to the test method described in clause 6.2 individual parameters influencing the speech quality can be assessed, in single and double talk situations. The test methodology allows the assessment of terminals as well as of network components and configurations. Further details can be found in annex D. ETSI ETSI TS 102 024-5 V4.1.1 (2003-09) 126.4 Mean One Way Delay Definition Mean one way delay is the time taken in milliseconds fo
