1、 ETSI TR 102 493 V1.2.1 (2009-06)Technical Report Speech and multimedia Transmission Quality (STQ);Guidelines for the use of Video Quality Algorithms for Mobile ApplicationsETSI ETSI TR 102 493 V1.2.1 (2009-06) 2Reference RTR/STQ-00137m Keywords QoS, telephony, video ETSI 650 Route des Lucioles F-06
2、921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice Individual copies of the present document can be downloaded from: http:/www.ets
3、i.org The present document may be made available in more than one electronic version or in print. In any case of existing or perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF). In case of dispute, the reference shall be the printing on
4、 ETSI printers of the PDF version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at http:/portal.
5、etsi.org/tb/status/status.asp If you find errors in the present document, please send your comment to one of the following services: http:/portal.etsi.org/chaircor/ETSI_support.asp Copyright Notification No part may be reproduced except as authorized by written permission. The copyright and the fore
6、going restriction extend to reproduction in all media. European Telecommunications Standards Institute 2009. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTM, TIPHONTM, the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members. 3GPPTM is a Trade Mark of ETSI
7、 registered for the benefit of its Members and of the 3GPP Organizational Partners. LTE is a Trade Mark of ETSI currently being registered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association. ETSI ET
8、SI TR 102 493 V1.2.1 (2009-06) 3Contents Intellectual Property Rights 5g3Foreword . 5g31 Scope 6g32 References 6g32.1 Normative references . 6g32.2 Informative references 6g33 Definitions and abbreviations . 7g33.1 Definitions 7g33.2 Abbreviations . 7g34 General . 7g35 Services 8g35.1 Streaming . 9g
9、35.2 Conversational Multimedia 9g35.3 Video Telephony 9g36 QoS Scenarios 10g36.1 Key Scenarios . 10g36.2 Other scenarios . 10g37 Requirements for test systems for mobile networks . 11g37.1 Sequence and observation length . 11g37.2 Content . 11g37.3 Algorithm Properties 11g37.3.1 Full reference perce
10、ptual algorithms. 11g37.3.2 No reference perceptual algorithms 12g37.3.3 No reference hybrid algorithms 12g37.3.4 Full reference hybrid algorithms . 12g37.3.5 Bitstream algorithms . 12g37.3.6 Parametric algorithms . 12g37.3.7 Video Codecs 13g37.3.8 Calculation time 13g37.4 Container schemes 13g37.5
11、Output . 13g38 Standardization of algorithms 13g38.1 Perceptual algorithms (J.246 and J.247) . 13g38.1.1 Sequence length 14g38.1.2 Content . 14g38.1.3 Formats . 14g38.1.4 Bit Rates . 14g38.1.5 Compressing algorithm 15g38.1.6 Container schemes 15g38.1.7 Evaluation. 15g38.1.8 Conclusions 15g38.2 Hybri
12、d, bitstream and parametric algorithms . 16g3Annex A (informative): Algorithms 17g3A.1 Measurement Methodologies . 17g3A.1.1 Full Reference Approach (FR) . 18g3A.1.2 No Reference Approach (NR) 18g3A.1.3 Reduced Reference Approach (RR) . 19g3A.1.4 Comparison of FR and NR Approaches . 20g3A.2 Degradat
13、ions and Metrics . 20g3ETSI ETSI TR 102 493 V1.2.1 (2009-06) 4A.2.1 Jerkiness . 20g3A.2.2 Freezing 20g3A.2.3 Blockiness 21g3A.2.4 Slice Error 21g3A.2.5 Blurring 21g3A.2.6 Ringing . 21g3A.2.7 Noise 21g3A.2.8 Colourfulness . 21g3A.2.9 MOS Prediction 21g3A.2.10 Comparison of NR and FR regarding metrics
14、 and Degradations . 22g3History 23g3ETSI ETSI TR 102 493 V1.2.1 (2009-06) 5Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members a
15、nd non-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (http:/webapp.etsi.or
16、g/IPR/home.asp). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essenti
17、al to the present document. Foreword This Technical Report (TR) has been produced by ETSI Technical Committee Speech and multimedia Transmission Quality (STQ). ETSI ETSI TR 102 493 V1.2.1 (2009-06) 61 Scope The present document gives guidelines for the use of video quality algorithms for the differe
18、nt services and scenarios applied in the mobile environment. 2 References References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For a specific reference, subsequent revisions do not apply. Non-specific reference may be made only t
19、o a complete document or a part thereof and only in the following cases: - if it is accepted that it will be possible to use all future changes of the referenced document for the purposes of the referring document; - for informative references. Referenced documents which are not found to be publicly
20、 available in the expected location might be found at http:/docbox.etsi.org/Reference. NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee their long term validity. 2.1 Normative references The following referenced documents are indispensabl
21、e for the application of the present document. For dated references, only the edition cited applies. For non-specific references, the latest edition of the referenced document (including any amendments) applies. Not applicable. 2.2 Informative references The following referenced documents are not es
22、sential to the use of the present document but they assist the user with regard to a particular subject area. For non-specific references, the latest version of the referenced document (including any amendments) applies. i.1 ETSI TS 126 233: “Universal Mobile Telecommunications System (UMTS); LTE; E
23、nd-to-end transparent streaming service; General description (3GPP TS 26.233 version 8.0.0 Release 8)“. i.2 VQEG: “Multimedia Group: Test Plan“, Draft Version 1.5, March 2005. i.3 ETSI TS 122 960: “Universal Mobile Telecommunications System (UMTS); Mobile Multimedia services including mobile Intrane
24、t and Internet services“. i.4 Final Report from the Video Quality Experts Group on the validation of the objective models of multimedia quality assessment, Phase. i.5 ITU-T Recommendation J.247: Objective perceptual multimedia video quality measurement in presence of a full reference. i.6 ITU-T Reco
25、mmendation J.246: Perceptual visual quality measurement techniques for multimedia services over digital cable television networks in the presence of a reduced bandwidth reference. ETSI ETSI TR 102 493 V1.2.1 (2009-06) 7i.7 ETSI TS 126 114: “Universal Mobile Telecommunications System (UMTS); LTE; IP
26、Multimedia Subsystem (IMS); Multimedia telephony; Media handling and interaction (3GPP TS 26.114 Release 7)“. 3 Definitions and abbreviations 3.1 Definitions For the purposes of the present document, the following terms and definitions apply: bitstream model: computational model that predicts the su
27、bjectively perceived quality of video, audio or multimedia, based on analysis of the payload and transport headers hybrid model: computational model that predicts the subjectively perceived quality of video, audio, or multimedia, based on the media signal and the payload and transport headers live S
28、treaming: streaming of live content e.g. web cam, TV programs, etc. parametric model: computational algorithm that predicts the subjectively perceived quality of video, based on transport layer and client parameters perceptual model: computational algorithm that aims to predict the subjectively perc
29、eived quality of video, based on the media signal streaming on demand: streaming of stored content e.g. movies 3.2 Abbreviations For the purposes of the present document, the following abbreviations apply: BLER BLock Error Rates CIF Common Intermediate Format (352 x 288 pixels) DMOS Difference Mean
30、Opinion Score FR Full Reference Algorithm HRC Hypothetical Reference Circuit ITU International Telecom standardization Union MOS Mean Opinion Score NR No Reference Algorithm PLR Packet Loss Rates PSNR Peak Signal Noise Ratio QCIF Quarter Common Intermediate Format (176 x 144 pixesls) RR Reduced Refe
31、rence SRC Source Reference Channel (or Circuit) VGA Video Graphics Adapter VQEG Video Quality Expert Group 4 General Video quality assessment has become a central issue with the increasing use of digital video compression systems and their delivery over mobile networks. Due to the nature of the codi
32、ng standards and delivery networks the provided quality will differ in time and space. Thus, methods for video quality assessment represent important tools to compare the performance of end-to-end applications. The present document sets the guidelines of video quality algorithms applicable for mobil
33、e applications and the scenarios of their application. Any eligible algorithm needs to predict the perceived quality by the user using mobile terminal equipment. The goal is to have one or more objective video quality measurement algorithm(s), which predicts the video quality as perceived by a human
34、 viewer, which is in conformance with the minimum requirements list given in the present document. ETSI ETSI TR 102 493 V1.2.1 (2009-06) 8On the input of the Video Quality Experts Group (VQEG) the ITU has recommended in ITU-T Recommendation J.247 i.5 an objective perceptual video quality measurement
35、 in the presence of a full reference and in ITU-T Recommendation J.246 i.6 a perceptual video quality measurement in the presence of a reduced reference. An objective perceptual multimedia video quality for no-reference algorithms has not been recommended. However continuing research within the VQEG
36、 is directed towards providing further input to the ITU on digital multimedia objective video quality measurement models. Work is going on in ITU-T and VQEG to develop and standardize hybrid, bitstream and parametric models. It is common to all services treated in the present document that quality a
37、s seen from the users perspective depends on the server and client applications used. For example, is has to be expected that under the same network conditions, two different video streaming clients will exhibit different video quality due to differences in the way these clients use available bandwi
38、dth. Therefore, for full validation of tools type and version of clients used has to be fully documented and are seen as part of the information needed to reproduce and calibrate measurements. NOTE: The present document focuses on those visual continuous media reproductions where the source and the
39、player are connected via a (mobile) telecommunication network rather than the replay of a clip that has been completely stored on the same device as the player and is replayed from there. 5 Services The aspect of video quality is of interest wherever there are services where the transfer of moving p
40、ictures or still images is involved. Three major fields of transferring video content can be identified that make use of packet switched and circuit switched services. Table 1: Requirement profiles of the services Application Symmetry Data rates One Way Delay Lip-sync Information loss Video telephon
41、y Two-way 32 kbps to 2 Mbps 150 ms preferred 400 ms limit 80 ms 1 % pl Streaming One-way 32 kbps to 2 Mbps 10 s 1 % pl Conversational Multimedia Two-way 150 ms Mutual service dependency, echo ETSI ETSI TR 102 493 V1.2.1 (2009-06) 9Figure 1: Streaming (TS 126 233 i.1) 5.1 Streaming Streaming refers t
42、o the ability of an application to play synchronized media streams like audio and video streams in a continuous way while those streams are being transmitted to the client over a data network. The client plays the incoming multimedia stream in real time as the data is received. Typical applications
43、can be classified into on-demand and live information delivery applications. Examples of the first group are music and news-on-demand applications. Live delivery of radio and television programs is an example of the second category. For 3G systems, the 3G packet-switched streaming service (PSS) fill
44、s the gap between 3G MMS, e.g. downloading, and conversational services. 5.2 Conversational Multimedia Multimedia services combine two or more media components within a call. The service where two or more parties exchange video, audio and text and maybe even share documents is a multimedia service.
45、Microsoft Netmeeting is an example for a conversational multimedia application i.3. This is a peer-to-peer set up in which one party acts as the source (server) and the other as client(s) and vice versa in real time. Another example of a new multimedia conversational service is the 3GPP standardized
46、 MTSI service i.7. 5.3 Video Telephony Video telephony is a full-duplex system, carrying both video and audio and intended for use in a conversational environment. In principle the same delay requirements as for conversational voice will apply, i.e. no echo and minimal effect on conversational dynam
47、ics, with the added requirement that the audio and video have to be synchronized within certain limits to provide “lip-synch“. ETSI ETSI TR 102 493 V1.2.1 (2009-06) 106 QoS Scenarios The different services that are making use of video can be delivered in a variety of ways and situations. To obtain t
48、he full picture of the quality of these services they need to be tested accordingly. However for practical purposes and general feasibility key scenarios need to be identified to facilitate video quality measurements. 6.1 Key Scenarios The key scenarios are live streaming, streaming on demand, video
49、 telephony and conversational multimedia. These services can be tested by drive test or in a static fashion. The algorithms for estimating video and audiovisual quality can be classified depending on: Type of input: - Perceptual (access to the video signal). - Bitstream (access to the transport layer payload, but not the video signal). - Hybrid (access to both the video signal and the transport layer payload). - Parametric (access to transport header, client information, and knowledge about used codecs). Access to reference video: The algo
