1、ETSI TS 1 O1 329-5 1.1.2 (2002-01) Technical Specificafion Telecommunications and Internet Protocol Harmonization Over Networks (TIPHON) Release 3; End-to-end Quality of Service in TIPHON systems; Part 5: Quality of Service (QoS) measurement methodologies 2 ETSI TS 101 329-5 VI .I .2 (2002-01) Refer
2、ence RTS/TlPHON-O5008a Keywords internet, IP, methodology, quality, service, system, telephony ETSI 650 Route des Lucioles F-O6921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 O0 Fax: +33 4 93 65 47 16 Siret No 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-prf
3、ecture de Grasse (06) No 7803/88 Important notice Individual copies of the present document can be downloaded from: http:l/w.etsi .orq The present document may be made available in more than one electronic version or in print. In any case of existing or perceived difference in contents between such
4、versions, the reference version is the Portable Document Format (PDF). In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject
5、to revision or change of status. Information on the current status of this and other ETSI documents is available at 3 If you find errors in the present document, send your comment to: Cori vriaht Notifica tion No part may be reproduced except as authorized by written permission. The copyright and th
6、e foregoing restriction extend to reproduction in all media. O European Telecommunications Standards Institute 2002. All rights reserved. ETSI 3 ETSI TS 101 329-5 VI .I .2 (2002-01) Contents Intellectual Property Rights . .5 Introduction . .6 Foreword . 5 1 2 3 3.1 3.2 3.3 4 5 5.1 5.2 5.3 5.4 6 6.1
7、6.2 6.3 6.4 6.5 6.6 6.7 7 7.1 7.2 7.3 7.4 7.5 7.6 7.7 7.8 7.9 7.10 8 8.1 8.2 Scope 7 References . .7 Definitions, symbols and abbreviations .8 . 8 . 8 . 9 Test Set-up for Terminals and Systems Including Terminals 10 Call Establishment Measurements . 1 O . 10 Start Dial Signal Delay . 10 Post Dial De
8、lay . . 11 Call Duration . . 11 Release on Request . Speech Quality Measurements . 11 Subjective Speech Qualit . 11 Objective Speech Qualit . 12 Advanced Objective Speech Quality Parameters . Mean One Way Delay Loudness Ratings . 13 Overall Transmission Quality Rating RI . Transport layer measuremen
9、ts 14 One way transmission time . Roundtrip transmission time 2 Point packet delay variation 1 Point packet delay variation Network packet loss . . 15 Effective packet loss . . 15 Packet errors . . 16 Mis-sequenced pac . . 16 . . 16 Packet loss correlation . . 16 QoS mechanism tests 17 17 Simulated
10、mecha for QoS calibration . 17 Passive media path monitoring for QoS . 12 13 13 14 Echo Path Loss . . 14 . 14 . 15 . 15 . . Annex A (normative): Call establishment measurements 18 Annex B (normative): Speech quality measurements . 19 B.l Delay measurement 19 Annex C (normative): QoS mechanism tests
11、. 21 Simulated media for QoS calibration . 21 Annex D (normative): Testing procedures for TIPHON terminals and systems . 24 D. 1 Introduction . .24 B.2 Loudness rating 20 C. 1 ETSI 4 ETSI TS 101 329-5 VI . 1 . 2 (2002-01) D.2 D.3 D.4 D.5 D.5.1 D.5.2 Parameters. defining speech transmission quality i
12、ncluding terminals 24 Test set-up for terminals and systems including terminals 25 D.3.1 Test Signals . . 25 Measurement of standard parameters . 25 Advanced Measurements, Taking Into Account the Conversational Situation 26 Measurement Set-up for objective tests . Practical realization of test signa
13、ls D.5.3 Test procedures . Annex E (informative): E . 1 E.2 E.3 E.4 Method for determining an equipment impairment factor using passive monitoring . 29 Introduction 29 Passive QoS Monitor Framework 29 Determining equipment impairment factor for packet loss 30 Determining Equipment Impairment Factor
14、for Packet Delay Variation . 32 E.5 Measuring Delay 33 E.6 E.7 Determining Equipment Impairment Factor for CODEC 33 Determining Overall Equipment Impairment Factor . 33 E.7.1 Determining Average Equipment Impairment Factor . . 33 E.7.2 Recency Effect . 34 Use of the E Model . 34 E.8 Annex F (informa
15、tive): Bibliography . 35 History 36 ETSI 5 ETSI TS 101 329-5 VI .I .2 (2002-01) Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI memb
16、ers and non-members, and can be found in ETSI SR O00 314: “Intellectual Property Rights (7PRs); Essential, orpotentially Essential, IPRs notlJied to ETSI in respect ofETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (5). Pursuant to t
17、he ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR O00 3 14 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. F
18、oreword This Technical Specification (TS) has been produced by ETSI Project Telecommunications and Internet Protocol Harmonization Over Networks (TIPHON). The present document is part 5 of a multi-part deliverable covering End-to-end Quality of Service in TIPHON systems, as identified below: TR 101
19、329-1: TS 101 329-2: TS 101 329-3: “General aspects of Quality of Service (QoS)“; “Definition of speech Quality of Service (QoS) classes“; “Signalling and control of end-to-end Quality of Service (QoS)“; TS 101 329-5: TR 101 329-6: “Quality of Service (QoS) measurement methodologies“; “Actual measur
20、ements of network and terminal characteristics and performance parameters in TIPHON networks and their influence on voice quality“; “Design guide for elements of a TIPHON connection from an end-to-end speech transmission performance point of view“. TR 101 329-7: Quality of Service aspects of TIPHON
21、Release 4 and 5 systems will be covered in TS 102 024 and TS 102 025 respectively (see Bibliography), and more comprehensive versions of the Release 3 documents listed above will be published as part of Release 4 and 5 as work progresses. ETSI 6 ETSI TS 101 329-5 VI .I .2 (2002-01) I n t rod uct ion
22、 The present document forms one of a series of technical specifications and technical reports produced by TIPHON Working Group 5 addressing Quality of Service (QoS) in TIPHON Systems. The structure of this work is illustrated in figure 1. Introduction Definition of 5 Speech Classes TR 101 329-1 Gene
23、ral Aspects of QoS TS 101 329-2 Speech QoS Classes f GenericQoS Specific Aspects of QoS TS 101 329-3 QoS Control TS 101 329-5 Measure- ment Methods QoS signalling requirements Measurement methodologies TR 101 329-6 Actual Test Results Repository of real test results TR 101 329-7 Design Guidelines Us
24、eful info for designers Figure 1: Structure of TIPHON QoS Documentation for Release 3 ETSI 7 ETSI TS 101 329-5 VI .I .2 (2002-01) 1 Scope The present document applies to IP networks that provide voice telephony in accordance with any of the TIPHON scenarios. It contains: - - test methodologies for e
25、nd to end QoS parameters; test methodologies for network performance parameters. It should be noted that the work has tried to reference already developed measurement techniques rather than defining new techniques unnecessarily. Background information and discussions are contained in the General Asp
26、ects of QoS document TR 101 329-1 i. 2 Re fe re nces The following documents contain provisions which, through reference in this text, constitute provisions of the present document. References are either specific (identified by date of publication andor edition number or version number) or non-speci
27、fic. For a specific reference, subsequent revisions do not apply. For a non-specific reference, the latest version applies. il ETSI TR 101 329-1: “Telecommunications and Internet Protocol Harmonization Over Networks (TIPHON) Release 3; End to End Quality of Service in TIPHON Systems; Part 1 : Genera
28、l aspects of Quality of Service (QoS)“. ITU-T Recommendation P.800: “Methods for subjective determination of transmission quality“. ITU-T Recommendation G. 13 1 : “Control of talker echo“. Draft ITU-T Recommendation P.861: “Perceptual Evaluation of Speech Quality (PESQ), an objective method for end-
29、to-end speech quality assessment of narrowband telephone networks and speech codecs“. ITU-T Recommendation G. 169: “Automatic level control devices“. ITU-T Recommendation P.340: “Transmission characteristics of hands-free telephones“ ITU-T Recommendation P.76: “Determination of loudness ratings; fun
30、damental principles“. ITU-T Recommendation P.79: “Calculation of Loudness Ratings for telephone sets“. ITU-T Recommendation G. 107: “The E-Model, a computational model for use in transmission planning“. ITU-T Recommendation G. 108: “Application of the E-model: A planning guide“. ITU-T Recommendation
31、 G. 177: “Transmission planning for voice-band services over hybrid Internet/PSTN connections“. ITU-T Recommendation P.59: “Artificial conversational speech“ ITU-T Recommendation P.501: “Test signals for use in telephonometry“ ITU-T Recommendation P.502: “Objective test methods for speech communicat
32、ion systems, using complex test signals“. ETSI 8 ETSI TS 101 329-5 VI .I .2 (2002-01) i151 i161 i171 i191 i181 i201 i211 i221 i231 i241 i251 i261 i271 i281 i291 i301 i3 11 i321 i331 ITU-T Recommendation P.58 1: “Use of head and torso simulator (HATS) for hands-free terminal testing“. ITU-T Recommend
33、ation P.83 1 : “Subjective performance evaluation of network echo cancellers“. ITU-T Recommendation P. 832: “Subjective performance evaluation of Hands-free Terminals“. ITU-T Recommendation P.5 1 : “Artificial mouths“. ITU-T Recommendation P.57: “Artificial ears“. ITU-T Recommendation P.58: “Head an
34、d torso simulator for telephonometry“. ITU-T Recommendation P.64: “Determination of sensitivity/frequency characteristics of local telephone systems“. ITU-T Recommendation P.50: “Artificial Voices“. ETSI TBR 8: “Integrated Services Digital Network (ISDN); Telephony 3,l kHz teleservice; Attachment re
35、quirements for handset terminals“. ITU-T Contribution COM12-42 Federal Republic of Germany: “Listening only test results for hands-free telephones and their dependence upon room surroundings (1 997)“. ITU-T Recommendation G.7 1 1 : “Pulse code modulation (PCM) of voice frequencies“. ITU-T Recommenda
36、tion G.726: “40,32,24, 16 kbit/s Adaptive Differential Pulse Code Modulation (ADPCM)“. ITU-T Recommendation G. 1 13 Appendix 1 : “Transmission Impairments - Appendix I: Provisional planning values for the equipment impairment factor Iet. ITU-T Recommendation G. 1 14: “One-way transmission time“. ITU
37、-T Contribution COM12-D139 France Tlcom R - percentage of calls with no dial tone. Comments None. 5.2 Post Dial Delay Definition Time in milliseconds between dialling the last digit and an audible tone being heard at the originating end. The audible tone is typically ring-back or the engaged tone. E
38、TSI 11 ETSI TS 101 329-5 VI .I .2 (2002-01) Test Metrics - post dial delay/ms. Comments Some systems have shown to present the user with a ring-back tone before a connection has been established, this gives the impression that the PDD is low. If the connection fails this is later switched to an enga
39、ged tone. This is unacceptable operation and should be tested. 5.3 Call Duration Definition The time in seconds between bi-directional media paLLL establishment and media path closure at both ends of the connection. Test Metrics - Call durations (accurate to 1 ms); - Percentage of premature releases
40、. Comments The call duration information can be used to check billing system accuracy. 5.4 Release on Request Definition Check to identi that connection is released when placing phone on-hook. Test Metrics - Percentage of correctly terminated calls. Comments None. 6 Speech Quality Measurements 6.1 S
41、ubjective Speech Quality Definition A subjective quality measure, or Mean Opinion Score (MOS), is determined from performing a subjective test in accordance with P.800 2. A MOS is an average opinion of quality for a system based on asking people their opinion of quality under control conditions. Fur
42、ther evaluation procedures specifically for echo canceller and hands-free terminal testing can be found in ITU-T Recommendations P.831 16 and P.832 17. Test Metrics - - Listening quality absolute category rating (P.800 2, annex B); Listening distortion category rating (P.800 2, annex D). ETSI 12 ETS
43、I TS 101 329-5 VI .I .2 (2002-01) Comments A subjective test, for TIPHON QoS class classification, should include the following reference conditions: - Clean speech; - - - G.711 25 with no additional distortions; G.726 26 at 32 kbit/s with no additional distortions; GSM FR with no additional distort
44、ions; - MNRU conditions (Q = 6, 12, 24 and 30). 6.2 Objective Speech Quality Definition A measure of speech quality by a computer based software program. The ETSI TIPHON project endorses the ITU-T Recommendation P. 86 1 4. Test Metrics - Speech Quality MOS prediction (ITU-T Recommendation P.861 4).
45、Comments It is paramount to use an appropriate speech or speech-like test signal. The signal should be at least 8 to 10 seconds in duration to ensure both system stability and the opportunity for errors to be assessed. 6.3 Advanced Objective Speech Quality Parameters Definition Various measures of s
46、peech quality parameters based on test signals and procedures are described in ITU-T Recommendations P.501 13, P.502 14 and P.340 6. Test Metrics - - - - - Convergence parameters of echo cancellers (section 4 of ITU-T Recommendation P.502 14); Speech quality parameters during double talk (section 5
47、of ITU-T Recommendation P.502 14); Companding and AGC characteristics (section 6 of ITU-T Recommendation P.502 14); Quality of background noise transmission (section 7 of ITU-T Recommendation P.502 14); Switching parameters (section 8 of ITU-T Recommendation P.502 14). Comments The tests require var
48、ious (speech-like) test signals as described in ITU-T Recommendation P.501 13 and ITU-T Recommendation P.50 22. The test duration should be at least 8 seconds to 10 seconds in duration to ensure both system stability and the opportunity for errors to be assessed. In addition to the test method descr
49、ibed in clause 6.2 individual parameters influencing the speech quality can be assessed, in single and double talk situations. The test methodology allows the assessment of terminals as well as of network components and configurations. Further details can be found in annex D. ETSI 13 ETSI TS 101 329-5 VI .I .2 (2002-01) 6.4 Mean One Way Delay Definition Mean one way delay is the time taken in milliseconds for a test signal to go from the near-end voice test point, traverse the network, get looped back at the far voice test point and arrive
