ITU-T H 264-2017 Advanced video coding for generic audiovisual services (Study Group 16).pdf

1、 I n t e r n a t i o n a l T e l e c o m m u n i c a t i o n U n i o n ITU-T H.264 TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU (04/2017) SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS Infrastructure of audiovisual services Coding of moving video Advanced video coding for generic audiovisual servic

2、es Recommendation ITU-T H.264 ITU-T H-SERIES RECOMMENDATIONS AUDIOVISUAL AND MULTIMEDIA SYSTEMS CHARACTERISTICS OF VISUAL TELEPHONE SYSTEMS H.100H.199 INFRASTRUCTURE OF AUDIOVISUAL SERVICES General H.200H.219 Transmission multiplexing and synchronization H.220H.229 Systems aspects H.230H.239 Communi

3、cation procedures H.240H.259 Coding of moving video H.260H.279 Related systems aspects H.280H.299 Systems and terminal equipment for audiovisual services H.300H.349 Directory services architecture for audiovisual and multimedia services H.350H.359 Quality of service architecture for audiovisual and

4、multimedia services H.360H.369 Telepresence H.420H.429 Supplementary services for multimedia H.450H.499 MOBILITY AND COLLABORATION PROCEDURES Overview of Mobility and Collaboration, definitions, protocols and procedures H.500H.509 Mobility for H-Series multimedia systems and services H.510H.519 Mobi

5、le multimedia collaboration applications and services H.520H.529 Security for mobile multimedia systems and services H.530H.539 Security for mobile multimedia collaboration applications and services H.540H.549 Mobility interworking procedures H.550H.559 Mobile multimedia collaboration inter-working

6、procedures H.560H.569 BROADBAND, TRIPLE-PLAY AND ADVANCED MULTIMEDIA SERVICES Broadband multimedia services over VDSL H.610H.619 Advanced multimedia services and applications H.620H.629 Ubiquitous sensor network applications and Internet of Things H.640H.649 IPTV MULTIMEDIA SERVICES AND APPLICATIONS

7、 FOR IPTV General aspects H.700H.719 IPTV terminal devices H.720H.729 IPTV middleware H.730H.739 IPTV application event handling H.740H.749 IPTV metadata H.750H.759 IPTV multimedia application frameworks H.760H.769 IPTV service discovery up to consumption H.770H.779 Digital Signage H.780H.789 E-HEAL

8、TH MULTIMEDIA SERVICES AND APPLICATIONS Personal health systems H.810H.819 Interoperability compliance testing of personal health systems (HRN, PAN, LAN, TAN and WAN) H.820H.859 Multimedia e-health data exchange services H.860H.869 For further details, please refer to the list of ITU-T Recommendatio

9、ns. Rec. ITU-T H.264 (04/2017) i Recommendation ITU-T H.264 Advanced video coding for generic audiovisual services Summary Recommendation ITU-T H.264 | International Standard ISO/IEC 14496-10 represents an evolution of the existing video coding standards (ITU-T H.261, ITU-T H.262, and ITU-T H.263) a

10、nd it was developed in response to the growing need for higher compression of moving pictures for various applications such as videoconferencing, digital storage media, television broadcasting, Internet streaming, and communication. It is also designed to enable the use of the coded video representa

11、tion in a flexible manner for a wide variety of network environments. The use of this Recommendation | International Standard allows motion video to be manipulated as a form of computer data and to be stored on various storage media, transmitted and received over existing and future networks and dis

12、tributed on existing and future broadcasting channels. The revision approved 2005-03 contained modifications of the video coding standard to add four new profiles, referred to as the High, High 10, High 4:2:2, and High 4:4:4 profiles, to improve video quality capability and to extend the range of ap

13、plications addressed by the standard (for example, by including support for a greater range of picture sample precision and higher-resolution chroma formats). Additionally, a definition of new types of supplemental data was specified to further broaden the applicability of the video coding standard.

14、 Finally, a number of corrections to errors in the published text were included. Corrigendum 1 to Rec. ITU-T H.264 corrected and updated various minor aspects to bring the ITU-T version of the text up to date relative to the April 2005 output status approved as a new edition of the corresponding joi

15、ntly-developed and technically-aligned text ISO/IEC 14496-10. It additionally fixed a number of minor errors and needs for clarification and defined three previously-reserved sample aspect ratio indicators. Amendment 1 “Support of additional colour spaces and removal of the High 4:4:4 Profile“ conta

16、ined alterations to Rec. ITU-T H.264 | ISO/IEC 14496-10 Advanced Video Coding to specify the support of additional colour spaces and to remove the definition of the High 4:4:4 profile. NOTE Rec. ITU-T H.264 is a twin text with ISO/IEC 14496-10 and this amendment was published in two different docume

17、nts in the ISO/IEC series: The removal of the High 4:4:4 profile was found in ISO/IEC 14496-10:2005/Cor.2. The specification for support of additional colour spaces was found in ISO/IEC 14496-10:2005/Amd.1. Amendment 2 “New profiles for professional applications“ contained extensions to Rec. ITU-T H

18、.264 | ISO/IEC 14496-10 Advanced Video Coding to specify the support of five additional profiles intended primarily for professional applications (the High 10 Intra, High 4:2:2 Intra, High 4:4:4 Intra, CAVLC 4:4:4 Intra, and High 4:4:4 Predictive profiles) and two new types of supplemental enhanceme

19、nt information (SEI) messages (the post-filter hint SEI message and the tone mapping information SEI message). Amendment 3 “Scalable video coding“ contained extensions to Rec. ITU-T H.264 | ISO/IEC 14496-10 Advanced Video Coding to specify a scalable video coding extension in three profiles (the Sca

20、lable Baseline, Scalable High, and Scalable High Intra profiles). The ITU-T H.264 edition published in 2005-11 included the text approved 2005-03 and its Corrigendum 1 approved 2005-09. ITU-T H.264 (2005) Amd.2 (2007) was available only as pre-published text since it was superseded by ITU-T H.264 Am

21、d.3 (2007-11) before its publication; further, ITU-T H.264 Amd.3 was not published separately. This third edition integrated into the ITU-T H.264 edition published in 2005-11 all changes approved in Amendments 1 (2006-06), 2 (2007-04) and 3 (2007-11). Corrigendum 1 (2009) provides a significant numb

22、er of minor corrections, clarifications, consistency improvements and formatting improvements drafted in response to accumulated errata reports collected since publication of the 2nd edition (dated 2005-03, which included a Cor.1 approved 2005-09). The ITU-T H.264 edition published in 2009-05 contai

23、ned enhancement extensions to support multiview video coding (MVC), specification of a “Constrained Baseline Profile“, and some miscellaneous corrections and clarifications. The ITU-T H.264 edition published in 2010-03 contained the specification of a new profile (the Stereo High profile) for two-vi

24、ew video coding with support of interlaced coding tools, the specification a new SEI message (the frame packing arrangement SEI message), and some miscellaneous corrections and clarifications. The ITU-T H.264 edition approved in 2011-06 contained the specification of a new level (Level 5.2) supporti

25、ng higher processing rates in terms of maximum macroblocks per second, a new profile (the Progressive High profile) to enable implementation of decoders supporting only the frame coding tools of the previously specified High profile, and included miscellaneous corrections and clarifications. The edi

26、tion of Rec. ITU-T H.264 approved in 2012-01 contained the specification of three additional profiles intended primarily for communication applications (the Constrained High, Scalable Constrained Baseline, and Scalable Constrained High profiles). The edition of Rec. ITU-T H.264 approved in 2013-04 c

27、ontained an additional profile for multiview video coding with depth information (the Multiview Depth High profile), and contained additional SEI message enhancements, additional colorimetry identifiers, and corrections and clarifications. The edition of Rec. ITU-T H.264 approved in 2014-02 specifie

28、d multi-resolution frame-compatible (MFC) enhancement for stereoscopic video coding, including the specification of an additional profile, the MFC High profile, an enhanced profile for combined multiview ii Rec. ITU-T H.264 (04/2017) video coding with depth information (the Enhanced Multiview Depth

29、High profile), and includes miscellaneous minor corrections and clarifications. The edition of Rec. ITU T H.264 approved in 2016-02 specified MFC stereoscopic video with depth maps, including the specification of an additional profile, the MFC Depth High profile, and the mastering display colour vol

30、ume SEI message, additional colour-related video usability information codepoint identifiers, and miscellaneous minor corrections and clarifications. The edition of Rec. ITU T H.264 approved in 2016-10, specified additional levels of decoder capability supporting larger picture sizes (Levels 6, 6.1,

31、 and 6.2), the green metadata SEI message, the alternative depth information SEI message, additional colour-related video usability information codepoint identifiers, and miscellaneous minor corrections and clarifications. This edition of Rec. ITU T H.264, approved in 2017-04, specifies the Progress

32、ive High 10 profile; the specification of support for additional colour-related indicators including the hybrid log-gamma transfer characteristics indication, the alternative transfer characteristics SEI message, the ICTCP colour matrix transformation, chromaticity-derived constant luminance and non

33、-constant luminance colour matrix coefficients, the colour remapping information SEI message; and miscellaneous minor corrections and clarifications. History Edition Recommendation Approval Study Group Unique ID* 1.0 ITU-T H.264 2003-05-30 16 11.1002/1000/6312 1.1 ITU-T H.264 (2003) Cor. 1 2004-05-0

34、7 16 11.1002/1000/7255 2.0 ITU-T H.264 2005-03-01 16 11.1002/1000/7825 2.1 ITU-T H.264 (2005) Cor. 1 2005-09-13 16 11.1002/1000/8572 2.2 ITU-T H.264 (2005) Amd. 1 2006-06-13 16 11.1002/1000/8811 2.3 ITU-T H.264 (2005) Amd. 2 2007-04-06 16 11.1002/1000/9036 3.0 ITU-T H.264 2007-11-22 16 11.1002/1000/

35、9226 3.1 ITU-T H.264 (2007) Cor. 1 2009-01-13 16 11.1002/1000/9519 4.0 ITU-T H.264 2009-03-16 16 11.1002/1000/9710 5.0 ITU-T H.264 2010-03-09 16 11.1002/1000/10635 6.0 ITU-T H.264 2011-06-29 16 11.1002/1000/11293 7.0 ITU-T H.264 2012-01-13 16 11.1002/1000/11466 8.0 ITU-T H.264 2013-04-13 16 11.1002/

36、1000/11830 9.0 ITU-T H.264 (V9) 2014-02-13 16 11.1002/1000/12063 10.0 ITU-T H.264 (V10) 2016-02-13 16 11.1002/1000/12641 11.0 ITU-T H.264 (V11) 2016-10-14 16 11.1002/1000/12904 12.0 ITU-T H.264 (V12) 2017-04-13 16 11.1002/1000/13189 * To access the Recommendation, type the URL http:/handle.itu.int/

37、in the address field of your web browser, followed by the Recommendations unique ID. For example, http:/handle.itu.int/11.1002/1000/11830-en. Rec. ITU-T H.264 (04/2017) iii FOREWORD The International Telecommunication Union (ITU) is the United Nations specialized agency in the field of telecommunica

38、tions, information and communication technologies (ICTs). The ITU Telecommunication Standardization Sector (ITU-T) is a permanent organ of ITU. ITU-T is responsible for studying technical, operating and tariff questions and issuing Recommendations on them with a view to standardizing telecommunicati

39、ons on a worldwide basis. The World Telecommunication Standardization Assembly (WTSA), which meets every four years, establishes the topics for study by the ITU-T study groups which, in turn, produce Recommendations on these topics. The approval of ITU-T Recommendations is covered by the procedure l

40、aid down in WTSA Resolution 1. In some areas of information technology which fall within ITU-Ts purview, the necessary standards are prepared on a collaborative basis with ISO and IEC. NOTE In this Recommendation, the expression “Administration“ is used for conciseness to indicate both a telecommuni

41、cation administration and a recognized operating agency. Compliance with this Recommendation is voluntary. However, the Recommendation may contain certain mandatory provisions (to ensure, e.g., interoperability or applicability) and compliance with the Recommendation is achieved when all of these ma

42、ndatory provisions are met. The words “shall“ or some other obligatory language such as “must“ and the negative equivalents are used to express requirements. The use of such words does not suggest that compliance with the Recommendation is required of any party. INTELLECTUAL PROPERTY RIGHTSITU draws

43、 attention to the possibility that the practice or implementation of this Recommendation may involve the use of a claimed Intellectual Property Right. ITU takes no position concerning the evidence, validity or applicability of claimed Intellectual Property Rights, whether asserted by ITU members or

44、others outside of the Recommendation development process. As of the date of approval of this Recommendation, ITU had received notice of intellectual property, protected by patents, which may be required to implement this Recommendation. However, implementers are cautioned that this may not represent

45、 the latest information and are therefore strongly urged to consult the TSB patent database at http:/www.itu.int/ITU-T/ipr/. ITU 2017 All rights reserved. No part of this publication may be reproduced, by any means whatsoever, without the prior written permission of ITU. iv Rec. ITU-T H.264 (04/2017

46、) Table of Contents Page 0 Introduction 1 0.1 Prologue 1 0.2 Purpose . 1 0.3 Applications 1 0.4 Publication and versions of this Specification 1 0.5 Profiles and levels . 3 0.6 Overview of the design characteristics . 4 0.6.1 Predictive coding 4 0.6.2 Coding of progressive and interlaced video 5 0.6

47、.3 Picture partitioning into macroblocks and smaller partitions 5 0.6.4 Spatial redundancy reduction 5 0.7 How to read this Specification 5 1 Scope 6 2 Normative references 6 3 Definitions 6 4 Abbreviations 14 5 Conventions 15 5.1 Arithmetic operators . 15 5.2 Logical operators 15 5.3 Relational ope

48、rators 15 5.4 Bit-wise operators . 16 5.5 Assignment operators . 16 5.6 Range notation 16 5.7 Mathematical functions . 16 5.8 Order of operation precedence 17 5.9 Variables, syntax elements, and tables 18 5.10 Text description of logical operations . 19 5.11 Processes . 20 6 Source, coded, decoded a

49、nd output data formats, scanning processes, and neighbouring relationships 20 6.1 Bitstream formats 20 6.2 Source, decoded, and output picture formats 20 6.3 Spatial subdivision of pictures and slices . 25 6.4 Inverse scanning processes and derivation processes for neighbours . 26 6.4.1 Inverse macroblock scanning process . 26 6.4.2 Inverse macroblock partition and sub-macroblock partition scanning process . 26 6.4.2.1 Inverse macroblock partition scanning process 27 6.4.2.2 Inverse sub-macroblock partition scanning process 27 6