1、 ETSI TS 103 222-2 V1.1.1 (2017-12) Speech and multimedia Transmission Quality (STQ); Reference benchmarking, background traffic profiles and KPIs; Part 2: Reference benchmarking and KPIs for High speed internet TECHNICAL SPECIFICATION ETSI ETSI TS 103 222-2 V1.1.1 (2017-12)2Reference DTS/STQ-219-2
2、Keywords KPI, QoS ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present document can be d
3、ownloaded from: http:/www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any exi
4、sting or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be su
5、bject to revision or change of status. Information on the current status of this and other ETSI documents is available at https:/portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comment to one of the following services: https:/portal.etsi.org
6、/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be modified without
7、the written authorization of ETSI. The copyright and the foregoing restriction extend to reproduction in all media. ETSI 2017. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are trademarks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are trademarks of ETSI reg
8、istered for the benefit of its Members and of the 3GPP Organizational Partners. oneM2M logo is protected for the benefit of its Members. GSM and the GSM logo are trademarks registered and owned by the GSM Association. ETSI ETSI TS 103 222-2 V1.1.1 (2017-12)3Contents Intellectual Property Rights 5g3F
9、oreword . 5g3Modal verbs terminology 5g3Introduction 5g31 Scope 6g32 References 6g32.1 Normative references . 6g32.2 Informative references 6g33 Definitions and abbreviations . 6g33.1 Definitions 6g33.2 Abbreviations . 7g34 Quality of service parameter values for High-speed internet . 7g34.0 KPIs ov
10、erview 7g34.1 PING 12g34.1.1 PING Packets Missing % . 12g34.1.2 PING Packet Errors % . 13g34.1.3 PING Failure Ratio % 13g34.2 HTTP 13g34.2.1 HTTP Response Time . 13g34.2.2 HTTP Download Throughput . 13g34.2.3 HTTP Download Throughput % of Bandwidth . 14g34.2.4 HTTP Percentage of invoiced Bandwidth %
11、 . 14g34.2.5 HTTP Upload Response Time 14g34.2.6 HTTP Upload Throughput 14g34.2.7 HTTP Upload Throughput % of Bandwidth 14g34.2.8 Number of HTTP Sessions . 14g34.2.9 HTTP Dropped Sessions % 15g34.2.10 HTTP Download Failure Ratio % 15g34.2.11 HTTP peak download throughput . 15g34.3 FTP . 15g34.3.1 FT
12、P Upload/Download Throughput . 15g34.3.2 FTP Upload/Download Throughput % of Bandwidth 15g34.3.3 FTP Percentage of invoiced Bandwidth % . 15g34.3.4 FTP Download Throughput % of Bandwidth 15g34.3.5 File Download/Upload Data Transfer Cut-off % . 15g34.3.6 FTP Download|Upload Service non-accessibility
13、% 16g34.3.7 FTP Download|Upload Retransmission Ratio 16g34.3.8 FTP Download|Upload packet loss rate % . 16g34.3.9 FTP Retransmission Ratio % . 16g34.4 TCP 16g34.4.1 TCP Round Trip Time (Server side) . 16g34.4.2 TCP Round Trip Time (Client side) . 17g34.4.3 TCP Retransmission Ratio 17g34.4.4 TCP Data
14、 Call Access Failure Ratio . 17g34.4.5 TCP Data Call Access Time . 17g34.4.6 TCP Server Response Time 18g35 Cloud Services 18g35.0 Introduction 18g35.1 DNS Lookup Time . 18g35.2 Web browsing indicators 18g35.2.1 Introduction. 18g35.2.2 HTTP Concepts 19g35.2.3 Website Response Time 20g3ETSI ETSI TS 1
15、03 222-2 V1.1.1 (2017-12)45.2.4 Website Load Duration Time 20g35.2.5 Website Session Duration Time 21g35.2.6 Website Download Failure Ratio 22g36 Streaming . 23g36.0 QoE Streaming Indicators 23g36.1 Streaming indicators . 23g36.2 Streaming Reproduction Cut-Off Ratio 24g36.3 Time to Stream Start. 24g
16、36.4 Streaming Reproduction Start Failure Ratio % 25g36.5 Total Number of Videos . 25g36.6 Total Reproduction Time . 25g36.7 Effective Reproduction Time . 25g36.8 Rebuffering Time Percentage . 25g36.9 Streaming Mean Data Rate . 26g36.10 Streaming Peak Data Rate 26g36.11 Effective Reproduction Time .
17、 26g36.12 Number Streaming Sessions . 26g37 Gaming . 26g37.0 Introduction 26g37.1 Number of Gaming Sessions 27g37.2 Gaming Session Duration . 27g37.3 Gaming Average Throughput Uplink . 27g37.4 Gaming Average Throughput Downlink 27g37.5 Gaming Packet Loss Ratio (Uplink/Downlink) 27g37.6 Gaming TCP Re
18、transmission Ratio (Uplink/Downlink) 28g37.7 Gaming End-to-end Latency 28g37.8 Gaming Traffic Volume (Uplink/Downlink) . 29g37.9 Daily Number of Unique Users 29g3History 30g3ETSI ETSI TS 103 222-2 V1.1.1 (2017-12)5Intellectual Property Rights Essential patents IPRs essential or potentially essential
19、 to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified t
20、o ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the
21、 existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Trademarks The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners. ET
22、SI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does not constitute an endorsement by ETSI of products, services or organizat
23、ions associated with those trademarks. Foreword This Technical Specification (TS) has been produced by ETSI Technical Committee Speech and multimedia Transmission Quality (STQ). The present document is part 2 of a multi-part deliverable covering Reference benchmarking, background traffic profiles an
24、d KPIs as identified below: Part 1: “Reference benchmarking, background traffic profiles and KPIs for VoIP and FoIP in fixed networks“; Part 2: “Reference benchmarking and KPIs for High speed internet“; Part 3: “Reference benchmarking, background traffic profiles and KPIs for UMTS and VoLTE“; Part 4
25、: “Reference benchmarking for IPTV, Web TV and RCS-e Video Share“. Modal verbs terminology In the present document “shall“, “shall not“, “should“, “should not“, “may“, “need not“, “will“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verb
26、al forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in direct citation. Introduction The present document describes the reference benchmarking, background traffic profiles and key performance indicators for high-speed internet. ETSI
27、 ETSI TS 103 222-2 V1.1.1 (2017-12)61 Scope The offer of new NGN services requires new KPIs, QoS measurement and benchmarking methods which are needed to ensure the quality of new services. To ensure the comparability of test results, reference benchmarking methods and background traffic load profil
28、es are needed. The present document describes key performance indicators and benchmarking methods for the spectrum of potential applications. All access technologies offered by the operator under test are considered. The present document is the second part of the multi-part deliverable which consist
29、s of four parts. The present document contains the Reference benchmarking and KPIs for High speed internet. 2 References 2.1 Normative references References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For specific references, only
30、the cited version applies. For non-specific references, the latest version of the referenced document (including any amendments) applies. Referenced documents which are not found to be publicly available in the expected location might be found at https:/docbox.etsi.org/Reference. NOTE: While any hyp
31、erlinks included in this clause were valid at the time of publication, ETSI cannot guarantee their long term validity. The following referenced documents are necessary for the application of the present document. 1 Recommendation ITU-T E.800 (2008): “Definitions of terms related to quality of servic
32、e“. 2 ETSI TS 102 250-2: “Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in mobile networks; Part 2: Definition of Quality of Service parameters and their computation“. 2.2 Informative references References are either specific (identified by date of publication an
33、d/or edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the referenced document (including any amendments) applies. NOTE: While any hyperlinks included in this clause were valid at the time of
34、 publication, ETSI cannot guarantee their long term validity. The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area. i.1 ETSI TR 101 578: “Speech and multimedia Transmission Quality (STQ); Qo
35、S aspects of TCP-based video services like YouTubeTM“. 3 Definitions and abbreviations 3.1 Definitions For the purposes of the present document, the following definition applies: benchmark: evaluation of performance value/s of a parameter or set of parameters for the purpose of establishing value/s
36、as the norm against which future performance achievements may be compared or assessed ETSI ETSI TS 103 222-2 V1.1.1 (2017-12)7NOTE: The definition is taken from Recommendation ITU-T E.800 1. 3.2 Abbreviations For the purposes of the present document, the following abbreviations apply: ACK Acknowledg
37、ement message DL DownLoad DNS Domain Name System E2E End-to-End FFS For Further Study FIN FIN message FTP File Transfer Protocol GET HTTP method GET HTTP Hypertext Transfer Protocol IAD Integrated Access DeviceICMP Internet Control Message Protocol IP Internet Protocol IPDV IP Delay Variation IPER I
38、P Packet Error Ratio IPLR IP Packet Loss RatioIPTD IP Packet Transfer Delay IPTV Internet Protocol Television KPI Key Performance Indicator NGN Next Generation Networks PING Packet INternet Groper (Send a packet to a computer and wait for its return) POST HTTP method POST QoE Quality of Experience Q
39、oS Quality of Service RTP Real-Time Transport Protocol RTT Round-Trip Time SYN SYNchronize Message TCP Transmission Control Protocol UDP User Datagram Protocol UE User Equipment UL UpLoad UMTS Universal Mobile Telecommunications System URI Uniform Resource Identifier VoIP Voice over IP 4 Quality of
40、service parameter values for High-speed internet 4.0 KPIs overview To determine the quality of high-speed internet connections, the following measurement and KPI values are determined. Table 4.0-1: Overview of quality benchmarks for DNS 1. DNS Lookup Time ms; see clause 5.1 2. DNS Lookup Failure Rat
41、io %; see clause 5.10 of 2 3. DNS Host Name Resolution Time; see clause 5.11 of 2 ETSI ETSI TS 103 222-2 V1.1.1 (2017-12)8Table 4.0-2: Overview of quality benchmarks for PING 1. PING Average Time ms; is defined in clause 6.3.1 of 2 2. PING packets missing %; see clause 4.1.1 3. PING Packets Errors %
42、; see clause 4.1.2 4. PING Failure Ratio; see clause 4.1.3 Table 4.0-3: Overview of quality benchmarks for HTTP 1. HTTP Service Non-Accessibility %; see clause 6.8.1 of 2 2. HTTP Setup Time s; see clause 6.8.2 of 2 3. HTTP IP Service Access Failure Ratio %; see clause 6.8.3 of 2 4. HTTP IP Service S
43、etup Time s; see clause 6.8.4 of 2 5. HTTP Session Failure Ratio %; see clause 6.8.5 of 2 6. HTTP Session Time s; see clause 6.8.6 of 2 7. HTTP Mean Data Rate kbit/s; see clause 6.8.7 of 2 8. HTTP Data Transfer Cut-off Ratio %; see clause 6.8.8 of 2 9. HTTP Content Compression Ratio %; see clause 6.
44、8.9 of 2 10. HTTP peak download throughput kbit/s; see clause 4.2.11 11. HTTP Response Time; see clause 4.2.1 12. HTTP Download Throughput; see clause 4.2.2 13. HTTP Download Throughput x % of Bandwidth; see clause 4.2.3 14. HTTP Percentage of invoiced Bandwidth; see clause 4.2.4 15. HTTP Upload Res
45、ponse Time; see clause 4.5 16. HTTP HTTP Upload Throughput; see clause 4.2.6 17. HTTP HTTP Upload Throughput; see clause 4.2.7 18. HTTP; Number of HTTP Sessions; see clause 4.2.8 19. HTTP HTTP Dropped Sessions; see clause 4.2.9 22. Number of HTTP Sessions (Daily number of http sessions); see clause
46、4.2.9 23. Traffic Volume DL (Daily total volume in Downlink) 24. Traffic Volume UL (Daily total volume in Uplink) 25. Number of active users 26. Average duration of HTTP sessions min ETSI ETSI TS 103 222-2 V1.1.1 (2017-12)9Table 4.0-4: Overview of quality of service parameters for FTP 1. FTP Downloa
47、d|Upload Setup Time s; see clause 6.1.2 of 2 2. FTP Download|Upload IP-Service Access Failure Ratio %; see clause 6.1.3 of 2 3. FTP Download|Upload IP-Service Setup Time s; see clause 6.1.4 of 2 4. FTP Download|Upload Session Failure Ratio %; see clause 6.1.5 of 2 5. FTP Download|Upload Session Time
48、 s; see clause 6.1.6 of 2 6. FTP Download|Upload Mean Data Rate kbit/s ; see clause 6.1.7 of 2 7. FTP Download|Upload Data Transfer Cut-off Ratio %; see clause 4.3.7 8. FTP Download|Upload Service non - Accessibility %; see clause 4.3.8 9. FTP Download|Upload throughput kbit/s; defined in clause 4.3
49、.1 10. FTP Upload/Download Throughput x % of Bandwidth; defined in clause 4.3.2 11. FTP Percentage of invoiced Bandwidth; defined in clause 4.3.3 12. FTP Download Throughput x % of Bandwidth; defined in clause 4.3.4 13. File Download/Upload Data Transfer Cut-off; defined in clause 4.3.5 14. FTP Download|Upload Service non - Accessibility %; defined in clause 4.3.6 15. FTP Retransmission Ratio; defined in clause 4.3.9 16. FT
