1、 ETSI EG 202 765-1 V1.1.2 (2010-07)ETSI Guide Speech and multimedia Transmission Quality (STQ);QoS and network performance metrics andmeasurement methods;Part 1: General considerationsETSI ETSI EG 202 765-1 V1.1.2 (2010-07) 2Reference REG/STQ-00174-1 Keywords network, performance, QoS ETSI 650 Route
2、 des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice Individual copies of the present document can be downloaded f
3、rom: http:/www.etsi.org The present document may be made available in more than one electronic version or in print. In any case of existing or perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF). In case of dispute, the reference shall
4、be the printing on ETSI printers of the PDF version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is availabl
5、e at http:/portal.etsi.org/tb/status/status.asp If you find errors in the present document, please send your comment to one of the following services: http:/portal.etsi.org/chaircor/ETSI_support.asp Copyright Notification No part may be reproduced except as authorized by written permission. The copy
6、right and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2010. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTM, TIPHONTM, the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM is a
7、Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners. LTE is a Trade Mark of ETSI currently being registered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM As
8、sociation. ETSI ETSI EG 202 765-1 V1.1.2 (2010-07) 3Contents Intellectual Property Rights 4g3Foreword . 4g3Introduction 4g31 Scope 6g32 References 6g32.1 Normative references . 6g32.2 Informative references 6g33 Abbreviations . 7g34 Determination of communications QoS criteria . 7g35 Presentation of
9、 indicators . 8g36 One-view visualization . 8g3History 10g3ETSI ETSI EG 202 765-1 V1.1.2 (2010-07) 4Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly ava
10、ilable for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web ser
11、ver (http:/webapp.etsi.org/IPR/home.asp). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may b
12、e, or may become, essential to the present document. Foreword This ETSI Guide (EG) has been produced by ETSI Technical Committee Speech and multimedia Transmission Quality (STQ). The present document is part 1 of a multi-part deliverable covering the QoS and network performance metrics and measureme
13、nt methods as identified below: EG 202 765-1: “General considerations“; ES 202 765-2: “Transmission Quality Indicator combining Voice Quality Metrics“; EG 202 765-3: “Network performance metrics and measurement methods in IP networks“; ES 202 765-4: “Indicators for supervision of Multiplay services“
14、. Introduction The QoS definition of ITU-T Recommendation G.1000 i.1 gives criteria for judging the quality of the communications functions that any service must support. However, even this definitional matrix can be viewed from different perspectives: customers QoS requirements; service providers o
15、fferings of QoS (or planned/targeted QoS); QoS achieved or delivered; customer survey ratings of QoS. ETSI ETSI EG 202 765-1 V1.1.2 (2010-07) 5T1213040-02CUSTOMERCustomersQoSRequirementsQoSPerceivedBy CustomerQoS OfferedBy ProviderQoSAchieved byProviderSERVICE PROVIDERFigure 1: The four viewpoints o
16、f QoS Under this angle of view the different parts of this multipart deliverable are positioned at different places in the matrix above: Part 1 (the present document) provides the umbrella for the different parts of this multi-part document as these are service specific (e.g. voice) (i.e. relevant a
17、nd perceivable by the end-user) on the one hand and transport network specific (e.g. IP) (i.e. relevant to the network itself and thus important to the network operator) on the other hand. Part 2 i.4 is identifying and defining indicators and methodologies for a use in a context of end-user quality
18、characterisation and supervision of voice telephony services. In this context the measurements and metric determinations are performed by analysing signals accessible on user-end services (end-user terminals and interfaces) and not on the network (network elements and interfaces within the network).
19、 In order to map the reality in terms of access to the services at the user-end side, measurements and analysis are performed on electrical signals that exclude the electro-acoustic part of the end equipment. However, the probe adaptation to electric interface of the end user equipment takes much in
20、to account the electro-acoustic characteristics of this terminal. Part 3 i.6 gives a survey on the existing network performance-related IETF standards and how these standards can be applied to end-to-end network performance measurements. The scope of this work is also to discuss the relationship of
21、those standards to those of ITU-T and ETSI. It discusses and compares definitions of metrics used to specify and assess performance in IP networks. The metrics addressed in this document are those defined by the IETF IPPM working group and ITU-T Study Group 12. Besides comparing the different defini
22、tions this document gives applicability guidelines on which metric is more appropriate for a particular application, configuration or scenario. Part 4 i.5 aims to identify and define indicators and methodologies for a use in a context of end-user quality characterisation and supervision of Multiplay
23、 services concerning IP access, voice messaging service, IPTV and as possible VoD. In this context the measurements (intrusive and non intrusive) and metric determinations are performed by analysing signals accessible on user-end services and not on the network. ETSI ETSI EG 202 765-1 V1.1.2 (2010-0
24、7) 61 Scope The present document provides the umbrella for the different parts of this multi-part document as these are service specific (e.g. Internet access, voice, IPTV and VoD) on the one hand and transport network specific (e.g. IP) on the other hand. The service specific part(s) are considered
25、 to be suitable for the quantitatively characterization of the dominant technical QoS aspects that have a direct influence on the QoS as experienced by the end-user. Thus these technical parameters can be taken as a measure to estimate the end-user quality perception and to benchmark services subseq
26、uently. The transport network specific(s) are considered to be suitable for the quantitatively characterization of the performance of the network as a whole and single network elements/functions. These parameters are used by the network operator to monitor the network performance, make a fault analy
27、sis and decide whether network upgrading/reconstruction, etc. needs to be undertaken. The quality of modern terminals and network equipment is characterized by numerous quality parameters. A subset of them, those which are found to be the most important ones (KPI _ Key Performance Indicator) are mea
28、sured during their lifetime and under real traffic conditions. These measurements guarantee the best possible assessment of quality problems that may occur during real use of the corresponding telecommunication device. 2 References References are either specific (identified by date of publication an
29、d/or edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the reference document (including any amendments) applies. Referenced documents which are not found to be publicly available in the expe
30、cted location might be found at http:/docbox.etsi.org/Reference. NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee their long term validity. 2.1 Normative references The following referenced documents are necessary for the application of t
31、he present document. Not applicable. 2.2 Informative references The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area. i.1 ITU-T Recommendation G.1000: “Communications Quality of Service: A f
32、ramework and definitions“. i.2 ITU-T Recommendation P.505: “One-view visualization of speech quality measurement results“. i.3 ETSI ETR 003: “Network Aspects (NA); General aspects of Quality of Service (QoS) and Network Performance (NP)“. i.4 ETSI ES 202 765-2: “Speech and multimedia Transmission Qu
33、ality (STQ); QoS and network performance metrics and measurement methods; Part 2 : Transmission Quality Indicator combining Voice Quality Metrics“. ETSI ETSI EG 202 765-1 V1.1.2 (2010-07) 7i.5 ETSI ES 202 765-4: “Speech and multimedia Transmission Quality (STQ); QoS and network performance metrics a
34、nd measurement methods; Part 4: Indicators for supervision of Multiplay services“. i.6 ETSI EG 202 765-3: “Speech and multimedia Transmission Quality (STQ); QoS and network performance metrics and measurement methods; Part 3: Network performance metrics and measurement methods in IP networks“. 3 Abb
35、reviations For the purposes of the present document, the following abbreviations apply: QoS Quality of Service QoE Quality of Experience VoIP Voice over Internet Protocol 4 Determination of communications QoS criteria Quality criteria of a telecommunications service may be derived from a matrix show
36、n in figure 1. Considerable thought has gone into its construction and has proven to be useful in identifying QoS criteria for customers before launching a new service (see ETR 003 i.3). Service Quality Criteria SPEED 1 ACCURACY 2 AVAILABILITY 3 RELIABILITY 4 SECURITY 5 SIMPLICITY 6 FLEXIBILITY 7 Se
37、rvice Function SERVICEMANAGEMENTSales & Pre-Contract Activities 1 Provision 2 Alteration 3 Service Support 4 Repair 5 Cessation 6 CONNECTIONQUALITYConnection Establsh. 7 Information Transfer 8 Connection Release 9 Billing 10 Network/Service management by customer 11 Figure 2: Matrix to facilitate id
38、entification of communications QoS criteria This matrix may be used for any telecommunications service to determine the requisite QoS criteria. After determining the quality criteria, parameters can be defined and performance objectives set. ETSI ETSI EG 202 765-1 V1.1.2 (2010-07) 85 Presentation of
39、 indicators The visualisation of indicators is an important issue, as the guidelines presented in the documents ES 202 765-2 i.4 and ES 202 765-4 i.5 may be used for benchmark or supervision of VoIP or Multiplay services. It is very important to present the quality indicators in a relevant way. This
40、 presentation allows us to make our own judgement of the global performance of the evaluated object. There is a great temptation to try to give one unique note which aggregates all quality items. Through its uniqueness, this note approaches the concepts of global evaluation and more generally of glo
41、bal satisfaction. But there are two problems of doing this aggregation. First, there is a gap between technical aspects and perceptive aspects. The links between these two aspects are not trivial. The second problem is that overall satisfaction or overall quality can hardly be modelled. Satisfaction
42、 and even quality strongly depends on expectancy levels and environment circumstances. As an example, you will be happy to call your wife/husband at the top of the mountain you climb, even if quality is poor and your QoE would be great. But with the same quality, if you call your wife/husband from y
43、our office, you will not and your QoE will be bad. Therefore it is difficult to evaluate quality using one unique note. It is recommended to visualise all indicators at the same time. 6 One-view visualization Obviously it is possible to represent every metric separately but it seems more convenient
44、to visualise all indicators (or at least all mandatory indicators) using the same and unique figure. This is described in ITU-T Recommendation P.505 i.2. The ITU-T Recommendation P.505 i.2 specifies a graphical visualisation called “Pie diagram“. This particular representation of indicators shows at
45、 a glance a global view of results obtained while characterising or analysing a service. It is easy to read as various indicators are represented on each spoke of the circle. This type of graphic is relatively flexible to employ. It is possible to choose the number of parameters to visualise. Howeve
46、r for intelligibility reasons it is not recommended to exceed twelve indicators. For telephony service the indicators for both directions of transmission can be visualised on the diagram. “Pie diagram“ also allows the comparison of obtained results with acceptability thresholds. The result will be r
47、epresented with green colour when the performance in above acceptability level. Otherwise, if the performance does not attain acceptability threshold the result will be drawn in red. An example of a “Pie-Diagram“ is shown in figure 3. ETSI ETSI EG 202 765-1 V1.1.2 (2010-07) 9Talker echo delayUnsucce
48、ssfull call ratioLevel of speech signalNoise levelSignal attenuationPost Dialing DelayTalker echo attenuationSpeech qualitySpeech quality stabilityEnd to end delayFrequency responceEnd to end delay variationFigure 3: Example on Pie-Diagram The ITU-T Recommendation P.505 i.2 enables a global vision o
49、f the complete set of indicators. It outlines the strengths and weaknesses of analysed service in a fast and convenient way. In order to recognise the benefits of the ITU-T Recommendation P.505 i.2 for the visualisation of indicators, one should contact ETSI to obtain the report from the 5thETSI Speech Quality Test Event. This document presents the results of analysis of several gateways and IPphones. The ITU-T Recommendation P.505 i.2 “Pie-Diagram“ allows not only the identification of strengths and weaknesses of every te
