1、 ETSI EG 203 165 V1.1.1 (2012-04) Speech and multimedia Transmission Quality (STQ); Throughput Measurement Guidelines ETSI Guide ETSI ETSI EG 203 165 V1.1.1 (2012-04)2Reference DEG/STQ-00162m Keywords 3G, GSM, network, QoS, service ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE
2、Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice Individual copies of the present document can be downloaded from: http:/www.etsi.org The present document may be ma
3、de available in more than one electronic version or in print. In any case of existing or perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF). In case of dispute, the reference shall be the printing on ETSI printers of the PDF version ke
4、pt on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at http:/portal.etsi.org/tb/status/status.asp If you
5、 find errors in the present document, please send your comment to one of the following services: http:/portal.etsi.org/chaircor/ETSI_support.asp Copyright Notification No part may be reproduced except as authorized by written permission. The copyright and the foregoing restriction extend to reproduc
6、tion in all media. European Telecommunications Standards Institute 2012. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are Trade Marks of ETSI registered for the benefit of its Members and of the 3G
7、PP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ETSI EG 203 165 V1.1.1 (2012-04)3Contents Intellectual Property Rights 5g3Foreword . 5g3Introduction 5g31 Scope 6g32 References 6g32.1 Normative references . 6g32.2 Informative referenc
8、es 6g33 Definitions, symbols and abbreviations . 7g33.1 Definitions 7g33.2 Symbols 7g33.3 Abbreviations . 7g34 General throughput measurement aspects 8g34.1 Purpose of the measurement . 8g34.2 Throughput equation 8g34.3 Throughput on different layers . 9g34.4 Throughput at different reference points
9、 11g34.5 Active and passive measurement 11g34.6 Load generation for active measurement of IP throughput 11g34.7 “Best effort“ versus “windowed“ approach 12g34.7.1 “Best effort“ approach. 12g34.7.2 “Windowed“ approach 13g34.7.3 Bias effect for “best effort“ and “windowed“ approaches . 13g34.7.4 First
10、 example 13g34.7.5 Conclusions from first example 14g34.7.6 Second example 14g34.7.7 Conclusions from second example . 15g34.7.8 Combining “best effort“ and “windowed“ approach . 15g34.8 Upper bounds for TCP throughput measurements . 16g35 Measurement environment aspects 16g35.1 Client/Server hardwa
11、re . 16g35.2 Operating System . 17g35.3 Performance Enhancement Proxies 17g35.4 Shared medium . 17g35.5 All traffic versus filtered traffic 18g35.5.1 User traffic 18g35.5.2 Multithreaded applications . 18g35.5.3 Aggregate traffic . 19g36 Campaign planning and evaluation 19g36.1 Mean user data rate v
12、ersus mean transfer time measurements . 19g36.1.1 Example 20g36.1.2 Conclusion 22g36.2 Throughput calculation based on time or traffic . 22g36.2.1 Non-sampled averaging 22g36.2.2 Sampled averaging 22g36.3 Busy hours or peak-off . 22g36.4 Working days or weekends 23g36.5 Locations 23g36.5.1 Mobility
13、aspects 23g36.5.2 Area categories . 23g36.6 Calculating sample mean 23g37 Throughput measurement checklists 23g3ETSI ETSI EG 203 165 V1.1.1 (2012-04)4Annex A: Analysing IP traces under different aspects . 28g3A.1 Layer-based analysis 28g3A.2 User-based analysis 28g3A.3 Volume-based analysis . 28g3A.
14、4 Time-based analysis . 29g3A.5 Examples 29g3History 30g3ETSI ETSI EG 203 165 V1.1.1 (2012-04)5Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly availabl
15、e for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (
16、http:/ipr.etsi.org). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, ess
17、ential to the present document. Foreword This ETSI Guide (EG) has been produced by ETSI Technical Committee Speech and multimedia Transmission Quality (STQ). Introduction The main purpose of the present document is to help the reader understand and differentiate between various throughput definition
18、s and calculation methods described in the TS 102 250 series and technical reports produced by STQ. This guide describes the different aspects (e.g. protocol-specific, measurement-environmental, statistical) which should be considered during planning, execution and evaluation of throughput measureme
19、nts in order to avoid the major problems which can occur. TS 102 250-2 i.2 standardizes throughput QoS parameters for popular IP based services used in mobile networks from the users point of view. Based on these definitions TS 102 250-7 i.6 defines a model for network quality. Finally, TR 102 678 i
20、.8 introduces a new method of throughput calculation based on fixed data transfer times. ETSI ETSI EG 203 165 V1.1.1 (2012-04)61 Scope The present document focuses on aspects of throughput measurements and their evaluation, providing different approaches. It contains factors, guidelines and backgrou
21、nd information that should be considered during selection, planning, execution and evaluation of throughput measurements. 2 References References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For specific references, only the cited v
22、ersion applies. For non-specific references, the latest version of the referenced document (including any amendments) applies. Referenced documents which are not found to be publicly available in the expected location might be found at http:/docbox.etsi.org/Reference. NOTE: While any hyperlinks incl
23、uded in this clause were valid at the time of publication, ETSI cannot guarantee their long term validity. 2.1 Normative references The following referenced documents are necessary for the application of the present document. Not applicable. 2.2 Informative references The following referenced docume
24、nts are not necessary for the application of the present document but they assist the user with regard to a particular subject area. i.1 ETSI TS 102 250-1: “Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in mobile networks; Part 1: Assessment of Quality of Service
25、“. i.2 ETSI TS 102 250-2: “Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in mobile networks; Part 2: Definition of Quality of Service parameters and their computation“. i.3 ETSI TS 102 250-3: “Speech and Multimedia Transmission and Quality (STQ); QoS aspects for
26、popular services in mobile networks; Part 3: Typical procedures for Quality of Service measurement equipment“. i.4 ETSI TS 102 250-4: “Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in mobile networks; Part 4: Requirements for Quality of Service measurement equipm
27、ent“. i.5 ETSI TS 102 250-6: “Speech Processing, Transmission and Quality Aspects (STQ); QoS aspects for popular services in GSM and 3G networks; Part 6: Post processing and statistical methods“. i.6 ETSI TS 102 250-7: “Speech and multimedia Transmission Quality (STQ); QoS aspects for popular servic
28、es in GSM and 3G networks; Part 7: Network based Quality of Service measurements“. i.7 ETSI TR 102 607: “Speech Processing, Transmission and Quality Aspects (STQ); TCP IP Stack Parameter Settings for Microsoft Windows XP and Microsoft Windows Vista; Comparison and Recommendations“. i.8 ETSI TR 102 6
29、78: “Speech and multimedia Transmission Quality (STQ); QoS Parameter Measurements based on fixed Data Transfer Times“. ETSI ETSI EG 203 165 V1.1.1 (2012-04)7i.9 ETSI TR 102 807: “Speech and multimedia Transmission Quality (STQ); Process description for the transaction view model“. i.10 ITU-T Recomme
30、ndation X.290: “OSI conformance testing methodology and framework for protocol Recommendations for ITU-T applications - General concepts“. i.11 IETF RFC 793: “Transmission Control Protocol“. i.12 IETF RFC 1323: “TCP Extensions for High Performance“. i.13 IETF RFC 3481: “TCP over Second (2.5G) and Th
31、ird (3G) Generation Wireless Networks“. i.14 M. Mathis, J. Semske, J. Mahdavi, and T. Ott: “The macroscopic behavior of the TCP congestion avoidance algorithm.“ Computer Communication Review, 27(3), July 1997. 3 Definitions, symbols and abbreviations 3.1 Definitions For the purposes of the present d
32、ocument, the following terms and definitions apply: application: software, using a particular service for providing related functionality to the user Point of Control and Observation (PCO): point within a testing environment where the occurrence of test events is to be controlled and observed NOTE:
33、A PCO is identified by a) a reference point or interface and b) a service access point (SAP) at the specified reference point or interface, indicating unambiguously where (usually in a protocol stack) events are observed (or other measurements are made). See ITU-T Recommendation X.290 i.10. service:
34、 capability of a specific layer and the layers beneath to provide a set of functions to higher layers NOTE: One example of the higher layers is the application layer. transmission capacity: maximum achievable throughput, which is determined by the physical characteristics of the transmission media N
35、OTE: Examples of the physical characteristics of the transmission media are transmission capacity, applied modulation and coding scheme. 3.2 Symbols For the purposes of the present document, the following symbols apply: tdPredefined measurement time period 3.3 Abbreviations For the purposes of the p
36、resent document, the following abbreviations apply: BMC Broadcast/Multicast Control CDF Cumulative Distribution Function CPU Central Processing Unit FDTT Fixed Data Transfer Time FTP File Transfer Protocol FTTX Fiber To The X (of any type) GGSN Gateway GPRS Support Node HDD Hard Disk Drive HSPA High
37、 Speed Packet Access HTTP HyperText Transfer Protocol ETSI ETSI EG 203 165 V1.1.1 (2012-04)8IP Internet Protocol ISO International Organisation for Standardization MAC Medium Access Control MSS Maximum Segment Size NAT Network Address Translation NP Network PerformanceOSI Open System Interconnection
38、 PCO Point of Control and Observation PDCP Packet Data Convergence Protocol PEP Performance Enhancement Proxy PHY PHYsical layer QoS Quality of Service RAM Random Access Memory RLC Radio Link Control RRC Radio Resource Control RTP Real Time Protocol RTSP Real Time Streaming Protocol RTT Round-Trip T
39、ime SDP Session Description Protocol SIM Subscriber Identity Module SMTP Simple Mail Transfer Protocol SYN TCP synchronise flag TCP Transmission Control Protocol TCP/IP Transmission Control Protocol / Internet Protocol UDP User Datagram Protocol UMTS Universal Mobile Telecommunications System USB Un
40、iversal Serial Bus 4 General throughput measurement aspects When measuring throughput, certain protocol-specific aspects always have an impact on measurement results. Thus, the purpose of the measurement and the respective measurement methodology has to be taken into account when evaluating and comp
41、aring measurement results. The specific protocol used to perform a measurement may have an impact on measurement results. In particular, throughput measurement results obtained using one protocol cannot generally be assumed to be transferrable to other protocols. For example, performing application
42、layer measurements in two different mobile networks using both FTP and HTTP can result in a situation where one network produces better results for FTP measurements while the other one produces better HTTP results. 4.1 Purpose of the measurement The three main parameters to characterise the actual p
43、erformance of an IP network are delay, packet loss and transmission capacity. The main cause why throughput is measured is to determine the achievable portion of the transmission capacity, being influenced by delay and packet loss, for different services. From a users point of view the throughput is
44、 a key performance measure for a dedicated service perceived by the user on application level. There is a notable difference between network throughput and application layer throughput which allows statements about Network Performance (NP) and Quality of Service (QoS), respectively. A proper disambi
45、guation of the different perspectives can be found in clauses 5.1 to 5.3 of TS 102 250-1 i.1. 4.2 Throughput equation Throughput can be calculated using the following equation. DurationDatadTransferreOfAmountThroughput =ETSI ETSI EG 203 165 V1.1.1 (2012-04)9The achievable IP transmission capacity is
46、 a highly variable stochastic parameter that varies in both small and large timescales. Every aspect of the throughput value has to be carefully listed; otherwise it can lead to misunderstandings. 4.3 Throughput on different layers During packet transmission many protocols are involved. On every pro
47、tocol stack layer the throughput metric can be interpreted. While from a users point of view only the highest protocol stack layer is important, from a network operators point of view the throughput on every protocol stack layer has its own meaning. Depending on the used layer different PCOs apply a
48、nd thus, the respective measurement results need to be treated accordingly. The concept of PCOs is explained in clause 7.1 of TS 102 250-1 i.1 and in clause 5.1 of TR 102 807 i.9. For network throughput measurements, different measurement environments and also different tools are needed to be compar
49、e to application layer measurements, since different protocol layers are involved accessible at their own reference points. Thus, the protocol layer has to be chosen and protocol-specific aspects like e.g. stationary state for TCP have to be taken into account. For performance assessments of different services with respect to these network characteristics, corresponding application traffic has to be generated and measured on a network with “live“ overall traffic load. Network throughput measurements and application layer throughp
