1、 ETSI TR 101 578 V1.2.1 (2015-07) Speech and multimedia Transmission Quality (STQ); QoS aspects of TCP-based video services like YouTube TECHNICAL REPORT ETSI ETSI TR 101 578 V1.2.1 (2015-07) 2 Reference RTR/STQ-00201m Keywords measurement, QoS, service, TCP-based video services ETSI 650 Route des L
2、ucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present document can be downloaded from: http:/www.etsi.org/sta
3、ndards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference in conte
4、nts between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status.
5、 Information on the current status of this and other ETSI documents is available at http:/portal.etsi.org/tb/status/status.asp If you find errors in the present document, please send your comment to one of the following services: https:/portal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Noti
6、fication No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be modified without the written authorization of ETSI. The copyright
7、 and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute 2015. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are Trade Marks of ETSI regist
8、ered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI TR 101 578 V1.2.1 (2015-07) 3 Contents Intellectual Property Rights 7g3Foreword . 7g3Modal verbs terminology 7g3Introduction 7g31 S
9、cope 9g32 References 9g32.1 Normative references . 9g32.2 Informative references 9g33 Abbreviations . 9g34 Quality of Service measurements for TCP-based video services like YouTube 10g34.0 General . 10g34.1 Phases of TCP-based video services 10g34.2 QoS aspects of TCP-based video services 12g34.2.0
10、Scope of aspects 12g34.2.1 Video freezes and - skips 12g34.2.2 Downloading with DASH. 12g34.3 QoS parameters for TCP-based video services 12g34.3.0 Paramater and trigger points . 12g34.3.1 Player IP Service Access Failure Ratio % 15g34.3.2 Player IP Service Access Time s 16g34.3.3 Player Download Cu
11、t-off Ratio % . 16g34.3.4 Player Download Time s 16g34.3.5 Player Session Failure Ratio % 16g34.3.6 Player Session Time s 16g34.3.7 Video IP Service Access Failure Ratio % 16g34.3.8 Video IP Service Access Time s 17g34.3.9 Video Reproduction Start Failure Ratio % . 17g34.3.10 Video Reproduction Star
12、t Delay s 17g34.3.11 Video Play Start Failure Ratio % . 17g34.3.12 Video Play Start Time s . 17g34.3.13 IP Service Access Failure Ratio % . 18g34.3.14 IP Service Access Time s . 18g34.3.15 Video Session Cut-off Ratio % 18g34.3.16 Video Session Time s . 18g34.3.17 Impairment Free Video Session Ratio
13、% . 18g34.3.18 Video Expected Size kbit . 19g34.3.19 Video Downloaded Size kbit 19g34.3.20 Video Compression Ratio % 19g34.3.21 Video Transfer Cut-off Ratio % . 20g34.3.22 Video Transfer Time s . 20g34.3.23 Video Mean User Data Rate kbit/s . 20g34.3.24 Video Playout Cut-off Ratio % 20g34.3.25 Video
14、Playout Cut-off Time s 20g34.3.26 Video Expected Duration s 21g34.3.27 Video Playout Duration s . 21g34.3.28 Video Freeze Occurrences 21g34.3.29 Accumulated Video Freezing Duration s . 21g34.3.30 Video Skip Occurrences . 21g34.3.31 Accumulated Video Skips Duration s 22g34.3.32 Video Maximum Freezing
15、 Duration s 22g34.3.33 Video Freezing Impairment Ratio % 22g34.3.34 Video Freezing Time Proportion 22g34.3.35 End-to-End Session Failure Ratio % 23g34.4 Recommended supplementary information for TCP-based video service measurements 23g3ETSI ETSI TR 101 578 V1.2.1 (2015-07) 4 4.5 Configuration aspect
16、s including timeout recommendations for TCP-based video service measurements . 23g34.5.0 Purpose . 23g34.5.1 URL 23g34.5.2 Timeouts . 24g34.5.2.0 Application of timeouts . 24g34.5.2.1 Player IP Service Access timeout 24g34.5.2.2 Player Download Time timeout 24g34.5.2.3 Video IP Service Access timeou
17、t 24g34.5.2.4 Video Reproduction Start Delay timeout 24g34.5.3 Video Playout Duration 24g34.5.4 Handling of video freezes . 25g34.5.4.0 Use of freezes 25g34.5.4.1 Minimum freeze duration 25g34.5.4.2 Maximum duration of single freeze 25g34.5.4.3 Maximum duration of all freezes 25g34.5.4.4 Maximum num
18、ber of freezes 25g34.5.5 Timeout and Threshold Frameworks 25g34.5.6 Hide video during playout 26g34.5.7 Play until the end 26g34.5.8 Cache and cookies 26g34.6 Impacts of measurement hardware for TCP-based video service measurements . 26g3Annex A: Measuring YouTube QoS with the Smartphone App 27g3A.0
19、. Introduction 27g3A.1. User observable phases of the clip reproduction 27g3A.2. QoS Parameter for You Tube with the Smartphone App . 28g3A.2.0 Parameter and trigger points . 28g3A.2.1 App Video Access Failure Ratio % . 28g3A.2.2 App Video Access Time s . 28g3A.2.3 App Video Playout Cut-off Ratio %
20、28g3A.2.4 App Video Playout Duration s . 29g3A.2.5 App Impairment Free Video Session Ratio % . 29g3A.2.6 App Video Freezing Time Ratio % . 29g3A.3. Configuration aspects . 29g3History 30g3ETSI ETSI TR 101 578 V1.2.1 (2015-07) 5 List of figures Figure 1: Typical phases of TCP-based video services .11
21、g3Figure A.1: Typical observable phases of Smartphone App video service .27g3ETSI ETSI TR 101 578 V1.2.1 (2015-07) 6 List of tables Table 1: Overview of QoS parameters and mapping to typical phases of TCP-based video services .13g3Table 2: Overview of the trigger points used for the QoS parameter de
22、finition .15g3Table 3: Observable quantities recommended getting included into the measurement results .23g3Table 4: Example settings that do model a standard user 26g3Table A.1: Overview of QoS parameters and mapping to typical phases of the video services as experienced by the user.28g3Table A.2:
23、Overview of the trigger points used for the QoS parameter definition 28g3ETSI ETSI TR 101 578 V1.2.1 (2015-07) 7 Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is
24、 publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the
25、 ETSI Web server (http:/ipr.etsi.org). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be,
26、or may become, essential to the present document. Foreword This Technical Report (TR) has been produced by ETSI Technical Committee Speech and multimedia Transmission Quality (STQ). Modal verbs terminology In the present document “shall“, “shall not“, “should“, “should not“, “may“, “need not“, “will
27、“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in direct citation. Introduction There are a variety of popular T
28、CP-based video services available on the internet, on which users can upload, view and share videos. These services use mainly Adobe Flash Video but also RealPlayer and QuickTime and lately HTML5 technology to display a wide variety of video content, including movie clips, TV clips, and music videos
29、, as well as amateur content such as video blogging and short original videos. NOTE 1: Adobe Flash is the trade name of a product supplied by Adobe. This information is given for the convenience of users of the present document and does not constitute an endorsement by ETSI of the product named. Equ
30、ivalent products may be used if they can be shown to lead to the same results. NOTE 2: RealPlayer is the trade name of a product supplied by RealNetworks. This information is given for the convenience of users of the present document and does not constitute an endorsement by ETSI of the product name
31、d. Equivalent products may be used if they can be shown to lead to the same results. NOTE 3: QuickTime is the trade name of a product supplied by Apple. This information is given for the convenience of users of the present document and does not constitute an endorsement by ETSI of the product named.
32、 Equivalent products may be used if they can be shown to lead to the same results. These services have become very popular and have a major share of the internet traffic worldwide. Due to its high popularity in general and its use over mobile internet its availability and quality is of key interest
33、of the provider of mobile internet access, which makes the services a matter for benchmarking. The down-stream scenario, the probability to access and see a desired video and the quality of the video is the subject of measurement method laid out in the present document. Any video content is accessed
34、 via a link that is provided by the service on a web page. The actual linked videos need to be qualified however e.g. YouTube provides different quality profiles of the same video content e.g. a music video clip. NOTE 4: YouTube is the trade name of a product supplied by Google. This information is
35、given for the convenience of users of the present document and does not constitute an endorsement by ETSI of the product named. Equivalent products may be used if they can be shown to lead to the same results. ETSI ETSI TR 101 578 V1.2.1 (2015-07) 8 The individual quality profiles can differ in reso
36、lution (e.g. 240p, 360p, 480p, HD720p, HD1080p), in the data-rate and other aspects. Since these differences of clips have an impact on their size and thus on the reproduction speed and quality, a fair comparison can only be provided if actually the same clips are streamed over different networks. O
37、n the other hand the clips not need to come physically from the same server since mobile operators employ proxies in order to move the content closer to their subscriber and the downlink bandwidth is often controlled primarily by the video service. Therefore the clips need to be streamed from the ac
38、tual live network and may not be streamed from a dedicated server. For cases in which the video content is compressed during the transfer by a proxy hence the content arriving at the subscriber is not identical, the compression ratio may be indicated to show that possible advantages in performance a
39、re achieved by reducing the amount of data to be transferred. Whether this enhancement was achieved at the cost of the general quality of the content could be determined by an objective video quality assessment. The TCP-based videos can be received either on Smartphone or a PC connected via mobile n
40、etwork to the internet. For the Smartphone the way the content is provided can differ significantly with the type and the OS the phone is using. In the present document content delivery for special Apps, RealPlayer and QuickTime is not taken into consideration but only the streaming over TCP as e.g.
41、 used by YouTube with a Browser on a PC or Smartphone with the respective player. ETSI ETSI TR 101 578 V1.2.1 (2015-07) 9 1 Scope The present document focuses on Quality of Service (QoS) measurements for TCP-based video services where downloading and viewing takes place in parallel. In principle the
42、 presented measurement approach can be used for all video services, where the video is embedded in a HTML context as of video on demand services like e.g. YouTube. Similar applications are also available on social networks. In the following, QoS parameters to be used for such video service measureme
43、nts are presented. The underlying procedure consists of two phases: first requesting a control script containing among other information a link to the content, and second, requesting this content. In the present document, YouTube serves as the default example but the described QoS parameters can eas
44、ily be applied to other TCP-based video services. Furthermore, the present document also offers practical guidance for measurement execution and evaluation of HTTP streaming QoS measurement. The present document covers the video request and playout of the video. Other services offered by content pro
45、viders such as e.g. uploading video or managing the private account are not covered. 2 References 2.1 Normative references References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For specific references, only the cited version appli
46、es. For non-specific references, the latest version of the reference document (including any amendments) applies. Referenced documents which are not found to be publicly available in the expected location might be found at http:/docbox.etsi.org/Reference. NOTE: While any hyperlinks included in this
47、clause were valid at the time of publication, ETSI cannot guarantee their long term validity. The following referenced documents are necessary for the application of the present document. Not applicable. 2.2 Informative references References are either specific (identified by date of publication and
48、/or edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the reference document (including any amendments) applies. NOTE: While any hyperlinks included in this clause were valid at the time of p
49、ublication, ETSI cannot guarantee their long term validity. The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area. i.1 ETSI TS 102 250-2: “Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in mobile networks; Part 2: Definition of Quality of Service parameters and their computation“. i.2 ETSI TS 102 250-5: “Speech and multimedia Transmissio
