ITU-T H 265-2018 High efficiency video coding (Study Group 16).pdf

1、 I n t e r n a t i o n a l T e l e c o m m u n i c a t i o n U n i o n ITU-T H.265 TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU (02/2018) SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS Infrastructure of audiovisual services Coding of moving video High efficiency video coding Recommendation ITU-T H.

2、265 ITU-T H-SERIES RECOMMENDATIONS AUDIOVISUAL AND MULTIMEDIA SYSTEMS CHARACTERISTICS OF VISUAL TELEPHONE SYSTEMS H.100H.199 INFRASTRUCTURE OF AUDIOVISUAL SERVICES General H.200H.219 Transmission multiplexing and synchronization H.220H.229 Systems aspects H.230H.239 Communication procedures H.240H.2

3、59 Coding of moving video H.260H.279 Related systems aspects H.280H.299 Systems and terminal equipment for audiovisual services H.300H.349 Directory services architecture for audiovisual and multimedia services H.350H.359 Quality of service architecture for audiovisual and multimedia services H.360H

4、.369 Telepresence H.420H.429 Supplementary services for multimedia H.450H.499 MOBILITY AND COLLABORATION PROCEDURES Overview of Mobility and Collaboration, definitions, protocols and procedures H.500H.509 Mobility for H-Series multimedia systems and services H.510H.519 Mobile multimedia collaboratio

5、n applications and services H.520H.529 Security for mobile multimedia systems and services H.530H.539 Security for mobile multimedia collaboration applications and services H.540H.549 VEHICULAR GATEWAYS AND INTELLIGENT TRANSPORTATION SYSTEMS (ITS) Architecture for vehicular gateways H.550H.559 Vehic

6、ular gateway interfaces H.560H.569 BROADBAND, TRIPLE-PLAY AND ADVANCED MULTIMEDIA SERVICES Broadband multimedia services over VDSL H.610H.619 Advanced multimedia services and applications H.620H.629 Ubiquitous sensor network applications and Internet of Things H.640H.649 IPTV MULTIMEDIA SERVICES AND

7、 APPLICATIONS FOR IPTV General aspects H.700H.719 IPTV terminal devices H.720H.729 IPTV middleware H.730H.739 IPTV application event handling H.740H.749 IPTV metadata H.750H.759 IPTV multimedia application frameworks H.760H.769 IPTV service discovery up to consumption H.770H.779 Digital Signage H.78

8、0H.789 E-HEALTH MULTIMEDIA SERVICES AND APPLICATIONS Personal health systems H.810H.819 Interoperability compliance testing of personal health systems (HRN, PAN, LAN, TAN and WAN) H.820H.859 Multimedia e-health data exchange services H.860H.869 For further details, please refer to the list of ITU-T

9、Recommendations. Rec. ITU-T H.265 v5 (02/2018) i Recommendation ITU-T H.265 High efficiency video coding Summary Recommendation ITU-T H.265 | International Standard ISO/IEC 23008-2 represents an evolution of the existing video coding Recommendations (ITU-T H.261, ITU-T H.262, ITU-T H.263 and ITU-T H

10、.264) and was developed in response to the growing need for higher compression of moving pictures for various applications such as Internet streaming, communication, videoconferencing, digital storage media and television broadcasting. It is also designed to enable the use of the coded video represe

11、ntation in a flexible manner for a wide variety of network environments. The use of this Recommendation | International Standard allows motion video to be manipulated as a form of computer data and to be stored on various storage media, transmitted and received over existing and future networks and

12、distributed on existing and future broadcasting channels. This revision adds additional SEI messages that include omnidirectional video SEI messages, a Monochrome 10 profile, a Main 10 Still Picture profile, and corrections to various minor defects in the prior content of the Specification. This Rec

13、ommendation | International Standard was developed jointly with ISO/IEC JTC 1/SC 29/WG 11 (MPEG) and corresponds in a technically aligned manner to ISO/IEC 23008-2. History Edition Recommendation Approval Study Group Unique ID* 1.0 ITU-T H.265 2013-04-13 16 11.1002/1000/11885 2.0 ITU-T H.265 (V2) 20

14、14-10-29 16 11.1002/1000/12296 3.0 ITU-T H.265 (V3) 2015-04-29 16 11.1002/1000/12455 4.0 ITU-T H.265 (V4) 2016-12-22 16 11.1002/1000/12905 5.0 ITU-T H.265 (V5) 2018-02-13 16 11.1002/1000/13433 Keywords Compression coding, digital video, image coding, video coding, video compression, visual coding. _

15、 * To access the Recommendation, type the URL http:/handle.itu.int/ in the address field of your web browser, followed by the Recommendations unique ID. For example, http:/handle.itu.int/11.1002/1000/11830-en. ii Rec. ITU-T H.265 v5 (02/2018) FOREWORD The International Telecommunication Union (ITU)

16、is the United Nations specialized agency in the field of telecommunications, information and communication technologies (ICTs). The ITU Telecommunication Standardization Sector (ITU-T) is a permanent organ of ITU. ITU-T is responsible for studying technical, operating and tariff questions and issuin

17、g Recommendations on them with a view to standardizing telecommunications on a worldwide basis. The World Telecommunication Standardization Assembly (WTSA), which meets every four years, establishes the topics for study by the ITU-T study groups which, in turn, produce Recommendations on these topic

18、s. The approval of ITU-T Recommendations is covered by the procedure laid down in WTSA Resolution 1. In some areas of information technology which fall within ITU-Ts purview, the necessary standards are prepared on a collaborative basis with ISO and IEC. NOTE In this Recommendation, the expression “

19、Administration“ is used for conciseness to indicate both a telecommunication administration and a recognized operating agency. Compliance with this Recommendation is voluntary. However, the Recommendation may contain certain mandatory provisions (to ensure, e.g., interoperability or applicability) a

20、nd compliance with the Recommendation is achieved when all of these mandatory provisions are met. The words “shall“ or some other obligatory language such as “must“ and the negative equivalents are used to express requirements. The use of such words does not suggest that compliance with the Recommen

21、dation is required of any party. INTELLECTUAL PROPERTY RIGHTSITU draws attention to the possibility that the practice or implementation of this Recommendation may involve the use of a claimed Intellectual Property Right. ITU takes no position concerning the evidence, validity or applicability of cla

22、imed Intellectual Property Rights, whether asserted by ITU members or others outside of the Recommendation development process. As of the date of approval of this Recommendation, ITU had received notice of intellectual property, protected by patents, which may be required to implement this Recommend

23、ation. However, implementers are cautioned that this may not represent the latest information and are therefore strongly urged to consult the TSB patent database at http:/www.itu.int/ITU-T/ipr/. ITU 2018 All rights reserved. No part of this publication may be reproduced, by any means whatsoever, wit

24、hout the prior written permission of ITU. Rec. ITU-T H.265 v5 (02/2018) iii CONTENTS Page 0 Introduction 1 0.1 General 1 0.2 Prologue 1 0.3 Purpose 1 0.4 Applications 1 0.5 Publication and versions of this Specification 2 0.6 Profiles, tiers and levels 2 0.7 Overview of the design characteristics 2

25、0.8 How to read this Specification 3 1 Scope 3 2 Normative references . 3 2.1 General 3 2.2 Identical Recommendations | International Standards 3 2.3 Paired Recommendations | International Standards equivalent in technical content 3 2.4 Additional references 4 3 Definitions 4 4 Abbreviations and acr

26、onyms 13 5 Conventions 15 5.1 General 15 5.2 Arithmetic operators . 15 5.3 Logical operators . 16 5.4 Relational operators 16 5.5 Bit-wise operators . 16 5.6 Assignment operators 17 5.7 Range notation 17 5.8 Mathematical functions . 17 5.9 Order of operation precedence 18 5.10 Variables, syntax elem

27、ents and tables . 19 5.11 Text description of logical operations . 20 5.12 Processes . 21 6 Bitstream and picture formats, partitionings, scanning processes and neighbouring relationships 21 6.1 Bitstream formats 21 6.2 Source, decoded and output picture formats . 21 6.3 Partitioning of pictures, sl

28、ices, slice segments, tiles, CTUs and CTBs . 23 6.3.1 Partitioning of pictures into slices, slice segments and tiles . 23 6.3.2 Block and quadtree structures . 24 6.3.3 Spatial or component-wise partitionings . 25 6.4 Availability processes . 26 6.4.1 Derivation process for z-scan order block availa

29、bility 26 6.4.2 Derivation process for prediction block availability . 26 6.5 Scanning processes . 27 6.5.1 CTB raster and tile scanning conversion process 27 6.5.2 Z-scan order array initialization process . 28 6.5.3 Up-right diagonal scan order array initialization process 29 6.5.4 Horizontal scan

30、 order array initialization process . 29 6.5.5 Vertical scan order array initialization process . 29 6.5.6 Traverse scan order array initialization process 30 7 Syntax and semantics . 30 7.1 Method of specifying syntax in tabular form 30 7.2 Specification of syntax functions and descriptors . 31 7.3

31、 Syntax in tabular form . 33 7.3.1 NAL unit syntax 33 7.3.2 Raw byte sequence payloads, trailing bits and byte alignment syntax 34 iv Rec. ITU-T H.265 v5 (02/2018) 7.3.3 Profile, tier and level syntax . 42 7.3.4 Scaling list data syntax 45 7.3.5 Supplemental enhancement information message syntax .

32、45 7.3.6 Slice segment header syntax . 46 7.3.7 Short-term reference picture set syntax . 51 7.3.8 Slice segment data syntax . 52 7.4 Semantics 66 7.4.1 General 66 7.4.2 NAL unit semantics 66 7.4.3 Raw byte sequence payloads, trailing bits and byte alignment semantics 74 7.4.4 Profile, tier and leve

33、l semantics 91 7.4.5 Scaling list data semantics 93 7.4.6 Supplemental enhancement information message semantics 96 7.4.7 Slice segment header semantics 96 7.4.8 Short-term reference picture set semantics . 103 7.4.9 Slice segment data semantics 105 8 Decoding process . 117 8.1 General decoding proc

34、ess . 117 8.1.1 General 117 8.1.2 CVSG decoding process . 118 8.1.3 Decoding process for a coded picture with nuh_layer_id equal to 0 . 118 8.2 NAL unit decoding process . 120 8.3 Slice decoding process 120 8.3.1 Decoding process for picture order count . 120 8.3.2 Decoding process for reference pic

35、ture set . 121 8.3.3 Decoding process for generating unavailable reference pictures 125 8.3.4 Decoding process for reference picture lists construction . 126 8.3.5 Decoding process for collocated picture and no backward prediction flag . 127 8.4 Decoding process for coding units coded in intra predi

36、ction mode 127 8.4.1 General decoding process for coding units coded in intra prediction mode 127 8.4.2 Derivation process for luma intra prediction mode . 130 8.4.3 Derivation process for chroma intra prediction mode . 132 8.4.4 Decoding process for intra blocks . 133 8.5 Decoding process for codin

37、g units coded in inter prediction mode 143 8.5.1 General decoding process for coding units coded in inter prediction mode 143 8.5.2 Inter prediction process . 144 8.5.3 Decoding process for prediction units in inter prediction mode . 146 8.5.4 Decoding process for the residual signal of coding units

38、 coded in inter prediction mode 171 8.6 Scaling, transformation and array construction process prior to deblocking filter process . 175 8.6.1 Derivation process for quantization parameters 175 8.6.2 Scaling and transformation process 176 8.6.3 Scaling process for transform coefficients 177 8.6.4 Tra

39、nsformation process for scaled transform coefficients 178 8.6.5 Residual modification process for blocks using a transform bypass . 181 8.6.6 Residual modification process for transform blocks using cross-component prediction 181 8.6.7 Picture construction process prior to in-loop filter process . 1

40、82 8.6.8 Residual modification process for blocks using adaptive colour transform 182 8.7 In-loop filter process . 184 8.7.1 General 184 8.7.2 Deblocking filter process 185 8.7.3 Sample adaptive offset process . 198 9 Parsing process . 200 9.1 General 200 9.2 Parsing process for 0-th order Exp-Golom

41、b codes 201 9.2.1 General 201 9.2.2 Mapping process for signed Exp-Golomb codes 202 9.3 CABAC parsing process for slice segment data . 203 9.3.1 General 203 9.3.2 Initialization process . 205 9.3.3 Binarization process 218 Rec. ITU-T H.265 v5 (02/2018) v 9.3.4 Decoding process flow 227 9.3.5 Arithme

42、tic encoding process (informative). 240 10 Sub-bitstream extraction process 246 Annex A Profiles, tiers and levels . 247 A.1 Overview of profiles, tiers and levels 247 A.2 Requirements on video decoder capability . 247 A.3 Profiles 247 A.3.1 General 247 A.3.2 Main profile 247 A.3.3 Main 10 and Main

43、10 Still Picture profiles . 248 A.3.4 Main Still Picture profile. 249 A.3.5 Format range extensions profiles 250 A.3.6 High throughput profiles . 255 A.3.7 Screen content coding extensions profiles 257 A.4 Tiers and levels . 261 A.4.1 General tier and level limits 261 A.4.2 Profile-specific level li

44、mits for the video profiles . 262 A.4.3 Effect of level limits on picture rate for the video profiles (informative) . 266 Annex B Byte stream format . 270 B.1 General 270 B.2 Byte stream NAL unit syntax and semantics 270 B.2.1 Byte stream NAL unit syntax 270 B.2.2 Byte stream NAL unit semantics 270

45、B.3 Byte stream NAL unit decoding process . 271 B.4 Decoder byte-alignment recovery (informative) . 271 Annex C Hypothetical reference decoder 272 C.1 General 272 C.2 Operation of coded picture buffer . 276 C.2.1 General 276 C.2.2 Timing of decoding unit arrival 276 C.2.3 Timing of decoding unit rem

46、oval and decoding of decoding unit 278 C.3 Operation of the decoded picture buffer 281 C.3.1 General 281 C.3.2 Removal of pictures from the DPB before decoding of the current picture 281 C.3.3 Picture output 281 C.3.4 Current decoded picture marking and storage . 282 C.3.5 Removal of pictures from t

47、he DPB after decoding of the current picture . 282 C.4 Bitstream conformance . 282 C.5 Decoder conformance . 284 C.5.1 General 284 C.5.2 Operation of the output order DPB . 285 Annex D Supplemental enhancement information 287 D.1 General 287 D.2 SEI payload syntax 287 D.2.1 General SEI message synta

48、x . 287 D.2.2 Buffering period SEI message syntax . 290 D.2.3 Picture timing SEI message syntax . 291 D.2.4 Pan-scan rectangle SEI message syntax 291 D.2.5 Filler payload SEI message syntax . 292 D.2.6 User data registered by Recommendation ITU-T T.35 SEI message syntax 292 D.2.7 User data unregiste

49、red SEI message syntax 292 D.2.8 Recovery point SEI message syntax . 292 D.2.9 Scene information SEI message syntax 293 D.2.10 Picture snapshot SEI message syntax . 293 D.2.11 Progressive refinement segment start SEI message syntax . 293 D.2.12 Progressive refinement segment end SEI message syntax 293 D.2.13 Film grain characteristics SEI message syntax . 294 D.2.14 Post-filter hint SEI message syntax . 294 D.2.15 Tone mapping information SEI message syntax . 295 vi Rec. ITU-T H.265 v5 (02/2018) D.2.16 Frame packing arrangement SEI