ITU-T H 265-2016 High efficiency video coding (Study Group 16).pdf

1、 I n t e r n a t i o n a l T e l e c o m m u n i c a t i o n U n i o n ITU-T H.265 TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU (12/2016) SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS Infrastructure of audiovisual services Coding of moving video High efficiency video coding Recommendation ITU-T H.

2、265 ITU-T H-SERIES RECOMMENDATIONS AUDIOVISUAL AND MULTIMEDIA SYSTEMS CHARACTERISTICS OF VISUAL TELEPHONE SYSTEMS H.100H.199 INFRASTRUCTURE OF AUDIOVISUAL SERVICES General H.200H.219 Transmission multiplexing and synchronization H.220H.229 Systems aspects H.230H.239 Communication procedures H.240H.2

3、59 Coding of moving video H.260H.279 Related systems aspects H.280H.299 Systems and terminal equipment for audiovisual services H.300H.349 Directory services architecture for audiovisual and multimedia services H.350H.359 Quality of service architecture for audiovisual and multimedia services H.360H

4、.369 Telepresence H.420H.429 Supplementary services for multimedia H.450H.499 MOBILITY AND COLLABORATION PROCEDURES Overview of Mobility and Collaboration, definitions, protocols and procedures H.500H.509 Mobility for H-Series multimedia systems and services H.510H.519 Mobile multimedia collaboratio

5、n applications and services H.520H.529 Security for mobile multimedia systems and services H.530H.539 Security for mobile multimedia collaboration applications and services H.540H.549 Mobility interworking procedures H.550H.559 Mobile multimedia collaboration inter-working procedures H.560H.569 BROA

6、DBAND, TRIPLE-PLAY AND ADVANCED MULTIMEDIA SERVICES Broadband multimedia services over VDSL H.610H.619 Advanced multimedia services and applications H.620H.629 Ubiquitous sensor network applications and Internet of Things H.640H.649 IPTV MULTIMEDIA SERVICES AND APPLICATIONS FOR IPTV General aspects

7、H.700H.719 IPTV terminal devices H.720H.729 IPTV middleware H.730H.739 IPTV application event handling H.740H.749 IPTV metadata H.750H.759 IPTV multimedia application frameworks H.760H.769 IPTV service discovery up to consumption H.770H.779 Digital Signage H.780H.789 E-HEALTH MULTIMEDIA SERVICES AND

8、 APPLICATIONS Personal health systems H.810H.819 Interoperability compliance testing of personal health systems (HRN, PAN, LAN, TAN and WAN) H.820H.859 Multimedia e-health data exchange services H.860H.869 For further details, please refer to the list of ITU-T Recommendations. Rec. ITU-T H.265 v4 (1

9、2/2016) i Recommendation ITU-T H.265 High efficiency video coding Summary Recommendation ITU-T H.265 | International Standard ISO/IEC 23008-2 represents an evolution of the existing video coding Recommendations (ITU-T H.261, ITU-T H.262, ITU-T H.263 and ITU-T H.264) and was developed in response to

10、the growing need for higher compression of moving pictures for various applications such as Internet streaming, communication, videoconferencing, digital storage media and television broadcasting. It is also designed to enable the use of the coded video representation in a flexible manner for a wide

11、 variety of network environments. The use of this Recommendation | International Standard allows motion video to be manipulated as a form of computer data and to be stored on various storage media, transmitted and received over existing and future networks and distributed on existing and future broa

12、dcasting channels. This revision adds screen content coding extensions profiles, scalable range extensions profiles, additional high throughput profiles, additional supplement enhancement information, additional colour representation identifiers, and corrections to various minor defects in the prior

13、 content of the Specification. This Recommendation | International Standard was developed jointly with ISO/IEC JTC 1/SC 29/WG 11 (MPEG) and corresponds in a technically aligned manner to ISO/IEC 23008-2. History Edition Recommendation Approval Study Group Unique ID* 1.0 ITU-T H.265 2013-04-13 16 11.

14、1002/1000/11885 2.0 ITU-T H.265 (V2) 2014-10-29 16 11.1002/1000/12296 3.0 ITU-T H.265 (V3) 2015-04-29 16 11.1002/1000/12455 4.0 ITU-T H.265 (V4) 2016-12-22 16 11.1002/1000/12905 _ * To access the Recommendation, type the URL http:/handle.itu.int/ in the address field of your web browser, followed by

15、 the Recommendations unique ID. For example, http:/handle.itu.int/11.1002/1000/11830-en. ii Rec. ITU-T H.265 v4 (12/2016) FOREWORD The International Telecommunication Union (ITU) is the United Nations specialized agency in the field of telecommunications, information and communication technologies (

16、ICTs). The ITU Telecommunication Standardization Sector (ITU-T) is a permanent organ of ITU. ITU-T is responsible for studying technical, operating and tariff questions and issuing Recommendations on them with a view to standardizing telecommunications on a worldwide basis. The World Telecommunicati

17、on Standardization Assembly (WTSA), which meets every four years, establishes the topics for study by the ITU-T study groups which, in turn, produce Recommendations on these topics. The approval of ITU-T Recommendations is covered by the procedure laid down in WTSA Resolution 1. In some areas of inf

18、ormation technology which fall within ITU-Ts purview, the necessary standards are prepared on a collaborative basis with ISO and IEC. NOTE In this Recommendation, the expression “Administration“ is used for conciseness to indicate both a telecommunication administration and a recognized operating ag

19、ency. Compliance with this Recommendation is voluntary. However, the Recommendation may contain certain mandatory provisions (to ensure, e.g., interoperability or applicability) and compliance with the Recommendation is achieved when all of these mandatory provisions are met. The words “shall“ or so

20、me other obligatory language such as “must“ and the negative equivalents are used to express requirements. The use of such words does not suggest that compliance with the Recommendation is required of any party. INTELLECTUAL PROPERTY RIGHTSITU draws attention to the possibility that the practice or

21、implementation of this Recommendation may involve the use of a claimed Intellectual Property Right. ITU takes no position concerning the evidence, validity or applicability of claimed Intellectual Property Rights, whether asserted by ITU members or others outside of the Recommendation development pr

22、ocess. As of the date of approval of this Recommendation, ITU had received notice of intellectual property, protected by patents, which may be required to implement this Recommendation. However, implementers are cautioned that this may not represent the latest information and are therefore strongly

23、urged to consult the TSB patent database at http:/www.itu.int/ITU-T/ipr/. ITU 2017 All rights reserved. No part of this publication may be reproduced, by any means whatsoever, without the prior written permission of ITU. Rec. ITU-T H.265 v4 (12/2016) iii CONTENTS Page 0 Introduction 1 0.1 General 1

24、0.2 Prologue 1 0.3 Purpose 1 0.4 Applications 1 0.5 Publication and versions of this Specification 2 0.6 Profiles, tiers and levels 2 0.7 Overview of the design characteristics 2 0.8 How to read this Specification 3 1 Scope 4 2 Normative references . 4 2.1 General 4 2.2 Identical Recommendations | I

25、nternational Standards 4 2.3 Paired Recommendations | International Standards equivalent in technical content 4 2.4 Additional references 4 3 Definitions 4 4 Abbreviations and acronyms 13 5 Conventions 15 5.1 General 15 5.2 Arithmetic operators . 15 5.3 Logical operators . 15 5.4 Relational operator

26、s 16 5.5 Bit-wise operators . 16 5.6 Assignment operators 16 5.7 Range notation 16 5.8 Mathematical functions . 17 5.9 Order of operation precedence 17 5.10 Variables, syntax elements and tables . 18 5.11 Text description of logical operations . 19 5.12 Processes . 20 6 Bitstream and picture formats

27、, partitionings, scanning processes and neighbouring relationships 20 6.1 Bitstream formats 20 6.2 Source, decoded and output picture formats . 21 6.3 Partitioning of pictures, slices, slice segments, tiles, coding tree units and coding tree blocks 23 6.3.1 Partitioning of pictures into slices, slic

28、e segments and tiles . 23 6.3.2 Block and quadtree structures . 24 6.3.3 Spatial or component-wise partitionings . 24 6.4 Availability processes . 25 6.4.1 Derivation process for z-scan order block availability 25 6.4.2 Derivation process for prediction block availability . 26 6.5 Scanning processes

29、 . 27 6.5.1 Coding tree block raster and tile scanning conversion process . 27 6.5.2 Z-scan order array initialization process . 28 6.5.3 Up-right diagonal scan order array initialization process 28 6.5.4 Horizontal scan order array initialization process . 29 6.5.5 Vertical scan order array initial

30、ization process . 29 6.5.6 Traverse scan order array initialization process 29 7 Syntax and semantics . 30 7.1 Method of specifying syntax in tabular form 30 7.2 Specification of syntax functions and descriptors . 31 7.3 Syntax in tabular form . 32 7.3.1 NAL unit syntax 32 7.3.2 Raw byte sequence pa

31、yloads, trailing bits and byte alignment syntax 33 iv Rec. ITU-T H.265 v4 (12/2016) 7.3.3 Profile, tier and level syntax . 41 7.3.4 Scaling list data syntax 43 7.3.5 Supplemental enhancement information message syntax . 44 7.3.6 Slice segment header syntax . 44 7.3.7 Short-term reference picture set

32、 syntax . 49 7.3.8 Slice segment data syntax . 50 7.4 Semantics 64 7.4.1 General 64 7.4.2 NAL unit semantics 64 7.4.3 Raw byte sequence payloads, trailing bits and byte alignment semantics 72 7.4.4 Profile, tier and level semantics 89 7.4.5 Scaling list data semantics 91 7.4.6 Supplemental enhanceme

33、nt information message semantics 93 7.4.7 Slice segment header semantics 94 7.4.8 Short-term reference picture set semantics . 101 7.4.9 Slice segment data semantics 103 8 Decoding process . 115 8.1 General decoding process . 115 8.1.1 General 115 8.1.2 CVSG decoding process . 116 8.1.3 Decoding pro

34、cess for a coded picture with nuh_layer_id equal to 0 . 116 8.2 NAL unit decoding process . 118 8.3 Slice decoding process 118 8.3.1 Decoding process for picture order count . 118 8.3.2 Decoding process for reference picture set . 119 8.3.3 Decoding process for generating unavailable reference pictu

35、res 123 8.3.4 Decoding process for reference picture lists construction . 123 8.3.5 Decoding process for collocated picture and no backward prediction flag . 124 8.4 Decoding process for coding units coded in intra prediction mode 125 8.4.1 General decoding process for coding units coded in intra pr

36、ediction mode 125 8.4.2 Derivation process for luma intra prediction mode . 128 8.4.3 Derivation process for chroma intra prediction mode . 130 8.4.4 Decoding process for intra blocks . 131 8.5 Decoding process for coding units coded in inter prediction mode 141 8.5.1 General decoding process for co

37、ding units coded in inter prediction mode 141 8.5.2 Inter prediction process . 142 8.5.3 Decoding process for prediction units in inter prediction mode . 144 8.5.4 Decoding process for the residual signal of coding units coded in inter prediction mode170 8.6 Scaling, transformation and array constru

38、ction process prior to deblocking filter process . 173 8.6.1 Derivation process for quantization parameters 173 8.6.2 Scaling and transformation process 174 8.6.3 Scaling process for transform coefficients 176 8.6.4 Transformation process for scaled transform coefficients 177 8.6.5 Residual modifica

39、tion process for blocks using a transform bypass . 179 8.6.6 Residual modification process for transform blocks using cross-component prediction 179 8.6.7 Picture construction process prior to in-loop filter process . 180 8.6.8 Residual modification process for blocks using adaptive colour transform

40、 180 8.7 In-loop filter process . 182 8.7.1 General 182 8.7.2 Deblocking filter process 183 8.7.3 Sample adaptive offset process . 196 9 Parsing process . 198 9.1 General 198 9.2 Parsing process for 0-th order Exp-Golomb codes 199 9.2.1 General 199 9.2.2 Mapping process for signed Exp-Golomb codes 2

41、00 9.3 CABAC parsing process for slice segment data . 201 9.3.1 General 201 9.3.2 Initialization process . 203 9.3.3 Binarization process 216 Rec. ITU-T H.265 v4 (12/2016) v 9.3.4 Decoding process flow 225 9.3.5 Arithmetic encoding process (informative). 238 10 Sub-bitstream extraction process 244 A

42、nnex A Profiles, tiers and levels . 245 A.1 Overview of profiles, tiers and levels 245 A.2 Requirements on video decoder capability . 245 A.3 Profiles 245 A.3.1 General 245 A.3.2 Main profile 245 A.3.3 Main 10 profile . 246 A.3.4 Main Still Picture profile. 247 A.3.5 Format range extensions profiles

43、 248 A.3.6 High throughput profiles . 253 A.3.7 Screen content coding extensions profiles 255 A.4 Tiers and levels . 259 A.4.1 General tier and level limits 259 A.4.2 Profile-specific level limits for the video profiles . 260 A.4.3 Effect of level limits on picture rate for the video profiles (infor

44、mative) . 264 Annex B Byte stream format . 267 B.1 General 267 B.2 Byte stream NAL unit syntax and semantics 267 B.2.1 Byte stream NAL unit syntax 267 B.2.2 Byte stream NAL unit semantics 267 B.3 Byte stream NAL unit decoding process . 268 B.4 Decoder byte-alignment recovery (informative) . 268 Anne

45、x C Hypothetical reference decoder 269 C.1 General 269 C.2 Operation of coded picture buffer . 273 C.2.1 General 273 C.2.2 Timing of decoding unit arrival 273 C.2.3 Timing of decoding unit removal and decoding of decoding unit 275 C.3 Operation of the decoded picture buffer 278 C.3.1 General 278 C.3

46、.2 Removal of pictures from the DPB before decoding of the current picture 278 C.3.3 Picture output 278 C.3.4 Current decoded picture marking and storage . 279 C.3.5 Removal of pictures from the DPB after decoding of the current picture . 279 C.4 Bitstream conformance . 279 C.5 Decoder conformance .

47、 281 C.5.1 General 281 C.5.2 Operation of the output order DPB . 282 Annex D Supplemental enhancement information 284 D.1 General 284 D.2 SEI payload syntax 284 D.2.1 General SEI message syntax . 284 D.2.2 Buffering period SEI message syntax . 287 D.2.3 Picture timing SEI message syntax . 288 D.2.4

48、Pan-scan rectangle SEI message syntax 288 D.2.5 Filler payload SEI message syntax . 289 D.2.6 User data registered by Recommendation ITU-T T.35 SEI message syntax 289 D.2.7 User data unregistered SEI message syntax 289 D.2.8 Recovery point SEI message syntax . 289 D.2.9 Scene information SEI message

49、 syntax 290 D.2.10 Picture snapshot SEI message syntax . 290 D.2.11 Progressive refinement segment start SEI message syntax . 290 D.2.12 Progressive refinement segment end SEI message syntax 290 D.2.13 Film grain characteristics SEI message syntax . 291 D.2.14 Post-filter hint SEI message syntax . 291 D.2.15 Tone mapping information SEI message syntax . 292 vi Rec. ITU-T H.265 v4 (12/2016) D.2.16 Frame packing arrangement SEI message syntax . 293 D.2.17 Display orientation SEI message syntax . 293 D.2.18 Green metadata SEI message