1、 ETSI ES 202 765-4 V1.2.1 (2014-05) Speech and multimedia Transmission Quality (STQ); QoS and network performance metrics and measurement methods; Part 4: Indicators for supervision of Multiplay services ETSI Standard ETSI ETSI ES 202 765-4 V1.2.1 (2014-05)2Reference RES/STQ-211 Keywords performance
2、, QoS ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present document can be downloaded fr
3、om: http:/www.etsi.org The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference
4、 in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change o
5、f status. Information on the current status of this and other ETSI documents is available at http:/portal.etsi.org/tb/status/status.asp If you find errors in the present document, please send your comment to one of the following services: http:/portal.etsi.org/chaircor/ETSI_support.asp Copyright Not
6、ification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be modified without the written authorization of ETSI. The copyrigh
7、t and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2014. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are Trade Marks of ETSI regis
8、tered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI ES 202 765-4 V1.2.1 (2014-05)3Contents Intellectual Property Rights 5g3Foreword . 5g31 Scope 6g32 References 6g32.1 Normative refe
9、rences . 6g32.2 Informative references 7g33 Symbols and abbreviations . 7g33.1 Symbols 7g33.2 Abbreviations . 7g34 General Overview. 8g35 Measurement type 9g36 List of Internet service indicators . 10g36.1 Availability of Internet Access . 10g36.2 Internet Download Bit Rate 11g36.3 Internet Upload B
10、it Rate . 12g36.4 Unsuccessful FTP Download session Ratio . 13g36.5 Unsuccessful FTP Upload session Ratio 13g36.6 Unsuccessful HTTP session Ratio 14g36.7 Ping Delay 15g36.8 Internet Login Time 16g36.9 Web page download Speed 17g36.10 FTP download Speed 17g36.11 FTP upload Speed 18g37 List of voice s
11、ervice indicators . 19g37.1 Voice messaging availability 19g37.2 Post Dialling Delay 20g37.3 Pick Up Delay 20g37.4 Message Provisioning Delay 20g37.5 Voice message quality 21g38 List of IPTV indicators . 22g38.1 Channel Availability. 22g38.2 Service Group Channel Availability. 23g38.3 Video Quality
12、. 23g38.4 Audio Quality . 24g38.5 “Black Screen“ Occurrences . 24g38.6 Blockiness Occurrences . 25g38.7 Frozen Picture Occurrences 25g38.8 Lip Desynchronization Occurrences 26g38.9 Zapping Delay 26g38.10 Transmission Delay 26g38.11 IPTV service boot delay . 27g39 List of VoD indicators 27g39.1 VoD S
13、ervice Availability . 27g39.2 Request Conformity . 28g39.3 VoD failure rate 28g39.4 Video Quality . 28g39.5 Audio Quality . 29g39.6 “Black Screen“ Occurrences . 29g39.7 Blockiness Occurrences . 30g39.8 Frozen Picture Occurrences 30g3ETSI ETSI ES 202 765-4 V1.2.1 (2014-05)410 Measurement frequency .
14、31g311 Measurement locations and their distribution 31g312 Results presentation 31g3Annex A (normative): Principle of artefact detection algorithms . 33g3A.1 Detection principle of frozen picture occurrence . 33g3A.2 Detection principle of “black screen“ occurrence 34g3A.3 Detection principle of blo
15、ckiness occurrence . 35g3Annex B (informative): Comparisons of ES 202 765-4 and TS 102 250-2 (V2.2.1) parameters 36g3Annex C (informative): Bibliography . 40g3History 41g3ETSI ETSI ES 202 765-4 V1.2.1 (2014-05)5Intellectual Property Rights IPRs essential or potentially essential to the present docum
16、ent may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of
17、ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (http:/ipr.etsi.org). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPR
18、s not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Foreword This ETSI Standard (ES) has been produced by ETSI Technical Committee Speech and multimedia Transmission Quality (STQ). The present document is
19、 part 4 of a multi-part deliverable covering the QoS metrics for telecommunication services and network performance metrics for transport networks, as identified below: EG 202 765-1: “General considerations“; ES 202 765-2: “Transmission Quality Indicator combining Voice Quality Metrics“; EG 202 765-
20、3: “Network performance metrics and measurement methods in IP networks“; ES 202 765-4: “Indicators for supervision of Multiplay services“. ETSI ETSI ES 202 765-4 V1.2.1 (2014-05)61 Scope The present document aims at identifying and defining indicators and methodologies for a use in a context of end-
21、user quality characterization and supervision of Multiplay services. In this context the measurements and metric determinations are performed by analysing signals accessible on user-end services and not on the network. The present document concerns: Internet access, voice messaging service, IPTV and
22、 VoD. The assessment methods are intrusive and non intrusive. 2 References References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest vers
23、ion of the reference document (including any amendments) applies. Referenced documents which are not found to be publicly available in the expected location might be found at http:/docbox.etsi.org/Reference. NOTE: While any hyperlinks included in this clause were valid at the time of publication ETS
24、I cannot guarantee their long term validity. 2.1 Normative references The following referenced documents are necessary for the application of the present document. 1 Void. 2 Recommendation ITU-T G.1030: “Estimating end-to-end performance in IP networks for data applications“. 3 Recommendation ITU-T
25、G.1010: “End-user multimedia QoS categories“. 4 IETF RFC 792: “Internet Control Message Protocol“. 5 ETSI TS 102 250-2 (V2.2.1): “Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in mobile networks; Part 2: Definition of Quality of Service parameters and their compu
26、tation“. 6 Recommendation ITU-T P.800: “Methods for subjective determination of transmission quality“. 7 Recommendation ITU-T P.862: “Perceptual evaluation of speech quality (PESQ): An objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs“. 8 R
27、ecommendation ITU-T P.862.1: “Mapping function for transforming P.862 raw result scores to MOS-LQO“. 9 Recommendation ITU-T P.862.3: “Application guide for objective quality measurement based on Recommendations P.862, P.862.1 and P.862.2“. 10 Recommendation ITU-T P.800.1: “Mean Opinion Score (MOS) t
28、erminology“. 11 Recommendation ITU-T P.505: “One-view visualization of speech quality measurement results“. 12 ETSI ES 202 765-2: “Speech and multimedia Transmission Quality (STQ); QoS and network performance metrics and measurement methods; Part 2 : Transmission Quality Indicator combining Voice Qu
29、ality Metrics“. ETSI ETSI ES 202 765-4 V1.2.1 (2014-05)713 Recommendation ITU-T P.863: “Perceptual objective listening quality assessment“. 14 Recommendation ITU-T P.863.1: “Application Guide for Recommendation ITU-T P.863“. 15 Recommendation ITU-T P.800.2: “Mean opinion score interpretation and rep
30、orting“. 2.2 Informative references The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area. i.1 ETSI TR 102 607: “Speech Processing, Transmission and Quality Aspects (STQ); TCP IP Stack Parame
31、ter Settings for Microsoft Windows XP and Microsoft Windows Vista; Comparison and Recommendations“. i.2 ETSI TR 102 505: “Speech and multimedia Transmission Quality (STQ); Development of a Reference Web page“. i.3 Recommendation ITU-T J.144: “Objective perceptual video quality measurement techniques
32、 for digital cable television in the presence of a full reference“. i.4 Recommendation ITU-T J.247: “Objective perceptual multimedia video quality measurement in the presence of a full reference“. i.5 ETSI EG 202 057-4: “Speech Processing, Transmission and Quality Aspects (STQ); User related QoS par
33、ameter definitions and measurements; Part 4: Internet Access“. 3 Symbols and abbreviations 3.1 Symbols For the purposes of the present document, the following symbols apply: 1 kbit/s 1 000 bit/s 1 Mbit/s 1 000 kbit/s kbps kilobit per second 3.2 Abbreviations For the purposes of the present document,
34、 the following abbreviations apply: ATM Asynchronous Transfer Mode BGP Border Gateway Protocol BRAS Broadband Remote Access Server CIF Common Intermediate Format CPE Customer Premises Equipment DHCP Dynamic Host Control Protocol DNS Domain Name System DSLAM Digital Subscriber Line Access Multiplexer
35、 ETSI European Telecommunications Standards Institute FQDN Fully Qualified Domain Name FTP File Transfer Protocol GE Gigabit Ethernet GSM Global System for Mobile communications HDMI High Definition Multimedia Interface HGW Home GateWay HTTP Hyper Text Transfer Protocol ICMP Internet Control Message
36、 Protocol IP Internet Protocol ETSI ETSI ES 202 765-4 V1.2.1 (2014-05)8IPTV Internet Protocol Television ISP Internet Service Provider ITU-T International Telecommunication Union - Telecommunication standardization sector LNS L2TP Network Server MOS Mean Opinion Score MOS-LQON Mean Opinion Store-Lis
37、tening Quality Objective Narrow-band MOS-LQOSW Mean Opinion Store-Listening Quality Objective Super Wide band MPEG Moving Picture Experts Group MPEG TS MPEG Transport Stream OLT Optical Line Termination PESQ Perceptual Evaluation of Speech Quality PSTN Public Switched Telephone Network QoS Quality o
38、f Service RTP Real Time Protocol RTT Round-Trip TimeS/PDIF Sony Philips Digital Interface STB Set Top Box TCP Transmission Control Protocol UDP User Datagram Protocol VoD Video on Demand VoIP Voice over Internet Protocol 4 General Overview The present document aims at identifying and defining indica
39、tors and methodologies for a use in a context of end-user quality characterization and supervision of multiplay telephony services such as Internet access, IPTV and VoD. It completes ES 202 765-2 12 that was dedicated to voice telephony services. The present document gives practical requirements of
40、use in the context of service verification and benchmark on a large and representative scale from the point of view of the potential stakeholders such as the end-users or of the regulatory authorities. This has been made necessary by the current or recent evolutions of the telecommunication sector:
41、a competitive environment for the offers of multiplay services with a multitude of service providers, with a quality guarantee not always assured and where clients can very easily change their service providers; the development of time varying quality in telecommunications, first in telephony with m
42、obile offers (due to mobility and irregular network coverage), but now also for multiplay services use in residential context (mostly due to IP transmission); the cohabitation, interaction and competition between services based on different technologies. The deployment of multiplay offers is increas
43、ing but quality guarantee is not always assured. To achieve the goal mentioned beforehand, there are several existing possibilities, not fully satisfying: Subjective tests, with a few human testers assessing the quality of services. This method is very long to run and not really cheap if we consider
44、 that there are many offers to be assessed. And it is not easily applicable in a context of quality changing over time. Objective tests. This is the most reliable way, although it is also based on sampling and can be very costly in the case of a large deployment of probes or robots. ETSI ETSI ES 202
45、 765-4 V1.2.1 (2014-05)9The present document assumes that this last family of methodology answers the needs of a reliable comparison of multiplay services. g3IP core network g3Audiovisual Service platformsVoIP Service platformsInternet g3Accessg3g3and Backhaulg3networksGame service platformsVoIP ser
46、viceInternet serviceIPTV and VoD servicesGame serviceFigure 1: Possible configuration of architecture of multiplay services The analysis of multiplay offers requires the simulation of user behaviour. In this context, robots and analyzers have to use and seek services in a very close way of a custome
47、r usage. What matters the most is the point of view of the end-users. What they perceive is not only the result of the transmission across the network, but also artefacts produce by the service platforms or service servers. In the present document the following services are considered: Internet acce
48、ss, voice messaging (in complement to telephony services addressed in ES 202 765-2 12), IPTV and VoD. A last important aspect addressed in the present document is the practical organization of measurement campaigns in order to get a realistic and reliable vision of the services as perceived by the e
49、nd-users. In particular, the questions of the periodicity of measurement and of the geographical coverage (i.e. more generally the sampling approach). These aspects are specified in clause 5. 5 Measurement type Considering the specific perimeter for the characterization of multiplay offer quality 24 hours a day and 7 days a week, analyses should be realized by robots. In this context, subjective evaluations are not adapted. The robot has to simulate the use of services by a user. Besides, the characterization of the offers
