ETSI TR 102 493-2017 Speech and multimedia Transmission Quality (STQ) Guidelines for the use of Video Quality Algorithms for Mobile Applications (V1 3 1).pdf

1、 ETSI TR 102 493 V1.3.1 (2017-07) Speech and multimedia Transmission Quality (STQ); Guidelines for the use of Video Quality Algorithms for Mobile Applications TECHNICAL REPORT ETSI ETSI TR 102 493 V1.3.1 (2017-07) 2 Reference RTR/STQ-00211m Keywords QoS, telephony, video ETSI 650 Route des Lucioles

2、F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N 348 623 562 00017 - NAF 742 C Association but non lucratif enregistre la Sous-Prfecture de Grasse (06) N 7803/88 Important notice The present document can be downloaded from: http:/www.etsi.org/standards-s

3、earch The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference in contents betw

4、een such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Informa

5、tion on the current status of this and other ETSI documents is available at https:/portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comment to one of the following services: https:/portal.etsi.org/People/CommiteeSupportStaff.aspx Copyright No

6、tification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI. The content of the PDF version shall not be modified without the written authorization of ETSI. The copyrig

7、ht and the foregoing restriction extend to reproduction in all media. ETSI 2017. All rights reserved. DECTTM, PLUGTESTSTM, UMTSTMand the ETSI logo are trademarks of ETSI registered for the benefit of its Members. 3GPPTM and LTE are trademarks of ETSI registered for the benefit of its Members and of

8、the 3GPP Organizational Partners. oneM2M logo is protected for the benefit of its Members. GSM and the GSM logo are trademarks registered and owned by the GSM Association. ETSI ETSI TR 102 493 V1.3.1 (2017-07) 3 Contents Intellectual Property Rights 5g3Foreword . 5g3Modal verbs terminology 5g31 Scop

9、e 6g32 References 6g32.1 Normative references . 6g32.2 Informative references 6g33 Definitions and abbreviations . 7g33.1 Definitions 7g33.2 Abbreviations . 7g34 General . 8g35 Services 9g35.0 Introduction 9g35.1 Streaming . 9g35.2 Conversational Multimedia 10g35.3 Video Telephony 10g36 QoS Scenario

10、s 10g36.0 General . 10g36.1 Measurement Scenarios 10g36.2 Other scenarios . 11g37 Requirements for test systems for mobile networks . 11g37.0 General . 11g37.1 Sequence and observation length . 11g37.2 Content . 12g37.3 Algorithms 12g37.3.1 Image-based algorithms 12g37.3.1.0 General 12g37.3.1.1 Imag

11、e-based algorithms with access to a reference 13g37.3.1.2 Image based no reference perceptual algorithms 13g37.3.2 Bitstream algorithms . 14g37.3.3 Parametric algorithms . 14g37.3.4 Supported Video Codecs 15g37.3.5 Calculation time 15g37.4 Container schemes 15g37.5 Output . 15g38 Standardized algori

12、thms for video quality prediction 15g38.0 General . 15g38.1 Bitstream based and parametric algorithms 16g38.2 Image based algorithms 16g3Annex A: Algorithms . 17g3A.0 Introduction 17g3A.1 Measurement Methodologies . 17g3A.1.0 Introduction 17g3A.1.1 Full Reference Approach (FR) . 17g3A.1.2 No Referen

13、ce Approach (NR) 18g3A.1.3 Reduced Reference Approach (RR) . 19g3A.1.4 Comparison of FR and NR Approaches . 20g3A.2 Degradations and Metrics . 20g3A.2.0 General . 20g3ETSI ETSI TR 102 493 V1.3.1 (2017-07) 4 A.2.1 Jerkiness . 20g3A.2.2 Freezing 20g3A.2.3 Blockiness 21g3A.2.4 Slice Error 21g3A.2.5 Blu

14、rring 21g3A.2.6 Ringing . 21g3A.2.7 Noise 21g3A.2.8 Colourfulness . 21g3A.2.9 MOS Prediction 21g3A.2.10 Comparison of NR and FR regarding metrics and Degradations . 22g3Annex B: Bibliography 23g3History 24g3ETSI ETSI TR 102 493 V1.3.1 (2017-07) 5 Intellectual Property Rights Essential patents IPRs e

15、ssential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSI SR 000 314: “Intellectual Property Rights (IPRs); Essential, or poten

16、tially Essential, IPRs notified to ETSI in respect of ETSI standards“, which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (https:/ipr.etsi.org/). Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No

17、 guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document. Trademarks The present document may include trademarks and/or tradenames which are asserted and/

18、or registered by their owners. ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does not constitute an endorsement by ETSI o

19、f products, services or organizations associated with those trademarks. Foreword This Technical Report (TR) has been produced by ETSI Technical Committee Speech and multimedia Transmission Quality (STQ). Modal verbs terminology In the present document “should“, “should not“, “may“, “need not“, “will

20、“, “will not“, “can“ and “cannot“ are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions). “must“ and “must not“ are NOT allowed in ETSI deliverables except when used in direct citation. ETSI ETSI TR 102 493 V1.3.1 (2017-07) 6 1 Sco

21、pe The present document gives guidelines for the use of video quality algorithms for the different services and scenarios applied in the mobile environment. 2 References 2.1 Normative references Normative references are not applicable in the present document. 2.2 Informative references References ar

22、e either specific (identified by date of publication and/or edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the referenced document (including any amendments) applies. NOTE: While any hyper

23、links included in this clause were valid at the time of publication, ETSI cannot guarantee their long term validity. The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area. i.1 ETSI TS 126 233

24、 (V13.0.0): “Universal Mobile Telecommunications System (UMTS); LTE; Transparent end-to-end Packet-switched Streaming service (PSS); General description (3GPP TS 26.233 version 13.0.0 Release 13)“. i.2 ETSI TS 126 114: “Universal Mobile Telecommunications System (UMTS); LTE; IP Multimedia Subsystem

25、(IMS); Multimedia telephony; Media handling and interaction (3GPP TS 26.114)“. i.3 Void. i.4 Recommendation ITU-T P.1201.1: “Parametric non-intrusive assessment of audiovisual media streaming quality - Lower resolution application area“. i.5 Recommendation ITU-T P.1201.2: “Parametric non-intrusive a

26、ssessment of audiovisual media streaming quality - Higher resolution application area“. i.6 Recommendation ITU-T P.1202.1: “Parametric non-intrusive bitstream assessment of video media streaming quality - Lower resolution application area“. i.7 Recommendation ITU-T P.1202.2: “Parametric non-intrusiv

27、e bitstream assessment of video media streaming quality - Higher resolution application area“. i.8 Recommendation ITU-T P.1203.1: “Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport - video quality estimation modu

28、le“. i.9 Recommendation ITU-T P.1203.2: “Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport - audio quality estimation module“. i.10 Recommendation ITU-T P.1203.3: “Parametric bitstream-based quality assessment of

29、 progressive download and adaptive audiovisual streaming services over reliable transport - Quality integration module“. i.11 Recommendation ITU-T J.343.1: “Hybrid-NRe objective perceptual video quality measurement for HDTV and multimedia IP-based video services in the presence of encrypted bitstrea

30、m data“. ETSI ETSI TR 102 493 V1.3.1 (2017-07) 7 i.12 Recommendation ITU-T J.343.2: “Hybrid-NR objective perceptual video quality measurement for HDTV and multimedia IP-based video services in the presence of non-encrypted bitstream data“. i.13 Recommendation ITU-T J.343.3: “Hybrid-RRe objective per

31、ceptual video quality measurement for HDTV and multimedia IP-based video services in the presence of a reduced reference signal and encrypted bitstream data“. i.14 Recommendation ITU-T J.343.4: “Hybrid-RR objective perceptual video quality measurement for HDTV and multimedia IP-based video services

32、in the presence of a reduced reference signal and non-encrypted bitstream data“. i.15 Recommendation ITU-T J.343.5: “Hybrid-FRe objective perceptual video quality measurement for HDTV and multimedia IP-based video services in the presence of a full reference signal and encrypted bitstream data“. i.1

33、6 Recommendation ITU-T J.343.6: “Hybrid-FR objective perceptual video quality measurement for HDTV and multimedia IP-based video services in the presence of a full reference signal and non-encrypted bitstream data“. i.17 Recommendation ITU-T J.246 (2008): “Perceptual visual quality measurement techn

34、iques for multimedia services over digital cable television networks in the presence of a reduced bandwidth reference“. i.18 Recommendation ITU-T J.247 (2008): “Objective perceptual multimedia video quality measurement in the presence of a full reference“. i.19 Recommendation ITU-T J.341 (2016): “Ob

35、jective perceptual multimedia video quality measurement of HDTV for digital cable television in the presence of a full reference“. 3 Definitions and abbreviations 3.1 Definitions For the purposes of the present document, the following terms and definitions apply: bitstream model: computational model

36、 that predicts the subjectively perceived quality of video, audio or multimedia, based on analysis of the payload and transport headers hybrid model: computational model that predicts the subjectively perceived quality of video, audio, or multimedia, based on the media signal and the payload and tra

37、nsport headers live Streaming: streaming of live content e.g. web cam, TV programs, etc. parametric model: computational algorithm that predicts the subjectively perceived quality of video, based on transport layer and client parameters perceptual model: computational algorithm that aims to predict

38、the subjectively perceived quality of video, based on the media signal streaming on demand: streaming of stored content e.g. movies 3.2 Abbreviations For the purposes of the present document, the following abbreviations apply: AVC Advanced Video Coding BLER BLock Error Rates CPU Central Processing U

39、nit DCT Discrete Cosine Transform FR Full Reference Algorithm ETSI ETSI TR 102 493 V1.3.1 (2017-07) 8 HD High Definition NOTE: 1 280 x 720 pixels, fullHD 1 920 x 1 080 pixels. HEVC High Efficiency Video Coding IMS IP Multimedia Subsystem IP Internet Protocol ITU International Telecom standardization

40、 Union JPEG Joint Photographic Expert Group (Standard) MM Multimedia MOS Mean Opinion Score MPEG Moving Picture Expert Group (Standard) MPEG-TS MPEG Transport Stream MTSI Multimedia Service for IMS NR No Reference AlgorithmPLR Packet Loss Rates PSNR Peak Signal Noise Ratio RR Reduced Reference RTP R

41、eal Time Protocol SD Standard DefinitionTCP Transport Control Protocol TV Television UDP User Datagram Procotol VGA Video Graphics Adapter VHS Video Home System 4 General Video quality assessment has become a central issue with the increasing use of digital video compression systems and their delive

42、ry over mobile networks. Due to the nature of the coding standards and delivery networks the provided quality will differ in time and space. Thus, methods for video quality assessment represent important tools to compare the performance of end-to-end applications. The present document sets the guide

43、lines of video quality algorithms applicable for mobile applications and the scenarios of their application. Any eligible algorithm needs to predict the quality perceived by the user using mobile terminal equipment. The goal is to have one or more objective video quality measurement algorithms, whic

44、h predict the video quality as perceived by a human viewer, which is in conformance with the minimum requirements list given in the present document. ITU-T has approved many different algorithms for objective prediction of visual quality in the last years. They can be differentiated in algorithms ba

45、sed on image analysis (the actual image is input to the algorithm) and bitstream-based measures (the IP stream is input of the model), and so-called hybrid models which combine image analysis with meta-information from the bitstream. These models have different scopes and limitations, they require d

46、ifferent input information and result in different predictions accuracy. For image based analysis ITU recommends a reduced reference algorithm in Recommendation ITU-T J.246 i.17 up to VGA resolution, multiple full-reference algorithms as in Recommendation ITU-T J.247 i.18 for all video resolutions u

47、p to VGA and the algorithm in Recommendation ITU-T J.341 i.19 for HD resolutions. Bitstream based models are described in Recommendations ITU-T P.1201 and P.1202 series (i.4 to i.7); there are differentiations for individual resolutions and for encrypted and non-encrypted bitstreams. In 2015 ITU app

48、roved a set of hybrid models in the Recommendation ITU-T J.343 series (i.11 to i.16), where J.343.1 i.11 and J.343.2 i.12 are no-reference hybrid models, J.343.3 i.13 and J.343.4 i.14 are reduced reference hybrid models and J.343.5 i.15 and J.343.6 i.16 are full-reference hybrid models. The odd suff

49、ix stands for models to be applicable for encrypted and non-encrypted bitstreams, while the models having an even suffix are only applicable to non-encrypted bitstreams. ETSI ETSI TR 102 493 V1.3.1 (2017-07) 9 It is common to all services treated in the present document that quality as seen from the users perspective depends on the server and client applications used. For example, is has to be expected that under the same network conditions, two different video streaming clients will exhibit different video quali