1、 I n t e r n a t i o n a l T e l e c o m m u n i c a t i o n U n i o n ITU-T Q.3933 TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU (06/2015) SERIES Q: SWITCHING AND SIGNALLING Testing specifications Testing specifications for next generation networks Reference benchmarking, background traffic profi
2、les and KPIs for VoIP and FoIP in fixed networks Recommendation ITU-T Q.3933 ITU-T Q-SERIES RECOMMENDATIONS SWITCHING AND SIGNALLING SIGNALLING IN THE INTERNATIONAL MANUAL SERVICE Q.1Q.3 INTERNATIONAL AUTOMATIC AND SEMI-AUTOMATIC WORKING Q.4Q.59 FUNCTIONS AND INFORMATION FLOWS FOR SERVICES IN THE IS
3、DN Q.60Q.99 CLAUSES APPLICABLE TO ITU-T STANDARD SYSTEMS Q.100Q.119 SPECIFICATIONS OF SIGNALLING SYSTEMS No. 4, 5, 6, R1 AND R2 Q.120Q.499 DIGITAL EXCHANGES Q.500Q.599 INTERWORKING OF SIGNALLING SYSTEMS Q.600Q.699 SPECIFICATIONS OF SIGNALLING SYSTEM No. 7 Q.700Q.799 Q3 INTERFACE Q.800Q.849 DIGITAL S
4、UBSCRIBER SIGNALLING SYSTEM No. 1 Q.850Q.999 PUBLIC LAND MOBILE NETWORK Q.1000Q.1099 INTERWORKING WITH SATELLITE MOBILE SYSTEMS Q.1100Q.1199 INTELLIGENT NETWORK Q.1200Q.1699 SIGNALLING REQUIREMENTS AND PROTOCOLS FOR IMT-2000 Q.1700Q.1799 SPECIFICATIONS OF SIGNALLING RELATED TO BEARER INDEPENDENT CAL
5、L CONTROL (BICC) Q.1900Q.1999 BROADBAND ISDN Q.2000Q.2999 SIGNALLING REQUIREMENTS AND PROTOCOLS FOR THE NGN Q.3000Q.3899 TESTING SPECIFICATIONS Q.3900Q.4099 Testing specifications for next generation networks Q.3900Q.3999 Testing specifications for SIP-IMS Q.4000Q.4039 Testing specifications for SIP
6、-IMS Q.4040Q.4099 For further details, please refer to the list of ITU-T Recommendations. Rec. ITU-T Q.3933 (06/2015) i Recommendation ITU-T Q.3933 Reference benchmarking, background traffic profiles and KPIs for VoIP and FoIP in fixed networks Summary Recommendation ITU-T Q.3933 describes key perfo
7、rmance indicators (KPIs) for voice over IP (VoIP) and fax over IP (FoIP) as well as framework requirements for reference benchmarking particularly with regard to background traffic. History Edition Recommendation Approval Study Group Unique ID* 1.0 ITU-T Q.3933 2015-06-13 11 11.1002/1000/12498 _ * T
8、o access the Recommendation, type the URL http:/handle.itu.int/ in the address field of your web browser, followed by the Recommendations unique ID. For example, http:/handle.itu.int/11.1002/1000/11830-en. ii Rec. ITU-T Q.3933 (06/2015) FOREWORD The International Telecommunication Union (ITU) is the
9、 United Nations specialized agency in the field of telecommunications, information and communication technologies (ICTs). The ITU Telecommunication Standardization Sector (ITU-T) is a permanent organ of ITU. ITU-T is responsible for studying technical, operating and tariff questions and issuing Reco
10、mmendations on them with a view to standardizing telecommunications on a worldwide basis. The World Telecommunication Standardization Assembly (WTSA), which meets every four years, establishes the topics for study by the ITU-T study groups which, in turn, produce Recommendations on these topics. The
11、 approval of ITU-T Recommendations is covered by the procedure laid down in WTSA Resolution 1. In some areas of information technology which fall within ITU-Ts purview, the necessary standards are prepared on a collaborative basis with ISO and IEC. NOTE In this Recommendation, the expression “Admini
12、stration“ is used for conciseness to indicate both a telecommunication administration and a recognized operating agency. Compliance with this Recommendation is voluntary. However, the Recommendation may contain certain mandatory provisions (to ensure, e.g., interoperability or applicability) and com
13、pliance with the Recommendation is achieved when all of these mandatory provisions are met. The words “shall“ or some other obligatory language such as “must“ and the negative equivalents are used to express requirements. The use of such words does not suggest that compliance with the Recommendation
14、 is required of any party. INTELLECTUAL PROPERTY RIGHTSITU draws attention to the possibility that the practice or implementation of this Recommendation may involve the use of a claimed Intellectual Property Right. ITU takes no position concerning the evidence, validity or applicability of claimed I
15、ntellectual Property Rights, whether asserted by ITU members or others outside of the Recommendation development process. As of the date of approval of this Recommendation, ITU had not received notice of intellectual property, protected by patents, which may be required to implement this Recommendat
16、ion. However, implementers are cautioned that this may not represent the latest information and are therefore strongly urged to consult the TSB patent database at http:/www.itu.int/ITU-T/ipr/. ITU 2015 All rights reserved. No part of this publication may be reproduced, by any means whatsoever, witho
17、ut the prior written permission of ITU. Rec. ITU-T Q.3933 (06/2015) iii Table of Contents Page 1 Scope . 1 2 References . 1 3 Definitions 3 3.1 Terms defined elsewhere 3 3.2 Terms defined in this Recommendation . 3 4 Abbreviations and acronyms 3 5 Conventions 4 6 Management summary 4 6.1 Scope of fu
18、nctionality . 5 7 Technical concept . 5 7.1 Voice over internet protocol (IP) 5 7.2 Call set-up delay and session initiation call set-up delay . 6 7.3 Call set-up time (post dialling delay) . 9 7.4 Premature release probability (call failure rate (CFR) 12 7.5 Telephony cut-off call ratio % (call dro
19、p rate) 12 7.6 Unsuccessful call ratio ETSI ETR 138 13 7.7 Media establishment delay . 13 7.8 Level of active speech signal in receive direction 14 7.9 Noise level in receive direction 14 7.10 Signal-to-noise ratio in receive direction . 14 7.11 Speech signal attenuation (or gain) 14 7.12 Talker ech
20、o delay . 14 7.13 Double talk performance 14 7.14 Interrupted voice transmission . 16 7.15 Listening speech quality . 16 7.16 Listening speech quality stability . 35 7.17 End-to-end audio delay . 35 7.18 End-to-end audio delay variation . 37 7.19 Frequency response in receive direction 37 7.20 Fax t
21、ransmission in accordance with ITU-T T.30 and ITU-T T.38 37 7.21 Early media listening speech quality 53 7.22 Jitter buffer and IP prioritization response time . 55 Rec. ITU-T Q.3933 (06/2015) 1 Recommendation ITU-T Q.3933 Reference benchmarking, background traffic profiles and KPIs for VoIP and FoI
22、P in fixed networks 1 Scope The offer of new next generation network (NGN) services requires new key performance indicators (KPIs), quality of service (QoS), measurement, and benchmarking methods which are needed to ensure the quality of new services. To ensure the comparability of test results, ref
23、erence benchmarking methods and background traffic load profiles are needed. This Recommendation identifies and defines KPIs for voice and fax telephony services, as well as benchmarking methods for the spectrum of potential applications. The scope of the defined testing procedures is the evaluation
24、 of the network access by VoIP and FoIP fixed-network services. The measurements are conducted stationary between a subscriber access-point to a measurement point emulating an idealized termination point in the core network. All access technologies offered by the operator under test are considered.
25、In this context, the measurements and KPIs determinations are performed by analysing signals which are accessible on the network. 2 References The following ITU-T Recommendations and other references contain provisions which, through reference in this text, constitute provisions of this Recommendati
26、on. At the time of publication, the editions indicated were valid. All Recommendations and other references are subject to revision; users of this Recommendation are therefore encouraged to investigate the possibility of applying the most recent edition of the Recommendations and other references li
27、sted below. A list of the currently valid ITU-T Recommendations is regularly published. The reference to a document within this Recommendation does not give it, as a stand-alone document, the status of a Recommendation. ITU-T E.453 Recommendation ITU-T E.453 (1994), Facsimile image quality as corrup
28、ted by transmission-induced scan line errors. ITU-T E.458 Recommendation ITU-T E.458 (1996), Figure of merit for facsimile transmission performance. ITU-T E.800 Recommendation ITU-T E.800 (2008), Definitions of terms related to quality of service. ITU-T G.131 Recommendation ITU-T G.131 (2003), Talke
29、r echo and its control. ITU-T G.711 Recommendation ITU-T G.711 (1988), Pulse code modulation (PCM) of voice frequencies. ITU-T H.248.1 Recommendation ITU-T H.248.1 V3 (2013), Gateway control protocol: Version 3. ITU-T O.41 Recommendation ITU-T O.41/P.53 (1994), Psophometer for use on telephone-type
30、circuits. ITU-T P.56 Recommendation ITU-T P.56 (2011), Objective measurement of active speech level. ITU-T P.340 Recommendation ITU-T P.340 (2000), Transmission characteristics and speech quality parameters of hands-free terminals. 2 Rec. ITU-T Q.3933 (06/2015) ITU-T P.501 Recommendation ITU-T P.501
31、 (2012), Test signals for use in telephonometry. ITU-T P.502 Recommendation ITU-T P.502 (2000), Objective test methods for speech communication systems using complex test signals. ITU-T P.863 Recommendation ITU-T P.863 (2014), Perceptual objective listening quality assessment. ITU-T P.863.1 Recommen
32、dation ITU-T P.863.1 (2014), Application guide for Recommendation ITU-T P.863. ITU-T Q.543 Recommendation ITU-T Q.543 (1993), Digital exchange performance design objectives. ITU-T T.24 Recommendation ITU-T T.24 (1998), Standardized digitized image set. ITU-T T.30 Recommendation ITU-T T.30 (2005), Pr
33、ocedures for document facsimile transmission in the general switched telephone network. ITU-T T.38 Recommendation ITU-T T.38 (2010), Procedures for real-time Group 3 facsimile communication over IP networks. ITU-T V.17 Recommendation ITU-T V.17 (1991), A 2-wire modem for facsimile applications with
34、rates up to 14 400 bit/s. ITU-T V.34 Recommendation ITU-T V.34 (1998), A modem operating at data signalling rates of up to 33 600 bit/s for use on the general switched telephone network and on leased point-to-point 2-wire telephone-type circuits. ITU-T V.152 Recommendation ITU-T V.152 (2010), Proced
35、ures for supporting voice-band data over IP networks. ETSI EG 202 057-2 ETSI EG 202 057-2 V1.3.2 (2011), Speech and multimedia Transmission Quality (STQ);User related QoS parameter definitions and measurements;Part 2: Voice telephony, Group 3 fax, modem data services and SMS. ETSI EG 202 425 ETSI EG
36、 202 425 V1.1.1 (2007), Speech Processing, Transmission and Quality Aspects (STQ); Definition and implementation of VoIP reference point. ETSI EN 300 175-8 ETSI EN 300 175-8 V2.5.1 (2013), Digital Enhanced Cordless Telecommunications (DECT); Common Interface (CI); Part 8: Speech and audio coding and
37、 transmission. ETSI ES 202 737 ETSI ES 202 737 V1.4.1 (2015), Speech and multimedia Transmission Quality (STQ); Transmission requirements for narrowband VoIP terminals (handset and headset) from a QoS perspective as perceived by the user. ETSI ES 202 739 ETSI ES 202 739 V1.4.1 (2015), Speech and mul
38、timedia Transmission Quality (STQ); Transmission requirements for wideband VoIP terminals (handset and headset) from a QoS perspective as perceived by the user. ETSI ES 202 765-2 ETSI ES 202 765-2 V1.2.1 (2014), Speech and multimedia Transmission Quality (STQ); QoS and network performance metrics an
39、d measurement methods; Part 2 : Transmission Quality Indicator combining Voice Quality Metrics. Rec. ITU-T Q.3933 (06/2015) 3 ETSI ES 203 021-3 ETSI ES 203 021-3 V2.1.2 (2006), Access and Terminals (AT); Harmonized basic attachment requirements for Terminals for connection to analogue interfaces of
40、the Telephone Networks; Update of the technical contents of TBR 021, EN 301 437, TBR 15, TBR 17; Part 3: Basic Interworking with the Public Telephone Networks. ETSI ETR 138 ETSI ETR 138 (1997), Network Aspects (NA); Quality of service indicators for Open Network Provision (ONP) of voice telephony an
41、d Integrated Services Digital Network (ISDN). ETSI TBR 003 ed.1 ETSI TBR 003 ed.1 (1995), Integrated Services Digital Network (ISDN); Attachment requirements for terminal equipment to connect to an ISDN using ISDN basic access. ETSI TBR 004 ed.1 ETSI TBR 004 ed.1 (1995), Integrated Services Digital
42、Network (ISDN); Attachment requirements for terminal equipment to connect to an ISDN using ISDN primary rate access. ETSI TBR 21 ETSI TBR 21 (1996-06), Terminal Equipment (TE); Attachment requirements for pan-European approval for connection to the analogue Public Switched Telephone Networks (PSTNs)
43、 of TE (excluding TE supporting the voice telephony service) in which network addressing, if provided, is by means of Dual Tone Multi Frequency (DTMF) signalling ETSI TR 103 138 ETSI TR 103 138, Speech and multimedia Transmission Quality (STQ); Speech samples and their use for QoS testing. ETSI TS 1
44、01 563 ETSI TS 101 563 V1.3.1 (2014), Speech and multimedia Transmission Quality (STQ); IMS/PES/VoLTE exchange performance requirements. ETSI TS 102 250-2 ETSI TS 102 250-2 V2.3.1 (2014), Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in GSM and 3G networks; Part
45、2: Definition of Quality of Service parameters and their computation. 3 Definitions 3.1 Terms defined elsewhere This Recommendation uses the following term defined elsewhere: 3.1.1 benchmark ITU-T E.800: Evaluation of performance value/s of a parameter or set of parameters for the purpose of establi
46、shing value/s as the norm against which future performance achievements may be compared or assessed. 3.2 Terms defined in this Recommendation None. 4 Abbreviations and acronyms This Recommendation uses the following abbreviations and acronyms: AGCF Access Gateway Control Function AS Application Serv
47、er CFR Call Failure Rate CSS Composite Source Signal DL Downlink 4 Rec. ITU-T Q.3933 (06/2015) DSS1 Digital Subscriber Signalling System No. 1 FoIP Fax over IP FOM Figure of Merit IAD Integrated Access Device IP Internet Protocol IPTV Internet Protocol Television IMS Internet Multimedia Subsystem IS
48、DN Integrated Services Digital Network KPI Key Performance Indicator LTE Long Term Evolution MOS Mean Opinion Score MOS-LQO MOS Listening Quality Objective MMTel Multimedia Telephony service PES PSTN Emulation Subsystem PSTN Public Switched Telephone Network QoS Quality of Service P-CSCF Proxy Call
49、Session Control Function S-CSCF Service Call Session Control Function SIP Session Initiation Protocol SIPUA SIP User Agent SNR Speech Signal level/Noise level SSL Secure Sockets Layer SWB Super Wideband TCP Transmission Control Protocol TLS Transport Layer Security UAS User Agent Server UE User Equipment UL Uplink VGW Voice Gateway VoIP Voice over IP 5 Conventions None. 6 Management summary The spectrum of potential applications of a benchmarking pla
