1、Adopted by INCITS (InterNational Committee for Information Technology Standards) as an American National Standard.Date of ANSI Approval: 5/10/2004Published by American National Standards Institute,25 West 43rd Street, New York, New York 10036Copyright 2004 by Information Technology Industry Council
2、(ITI).All rights reserved.These materials are subject to copyright claims of International Standardization Organization (ISO), InternationalElectrotechnical Commission (IEC), American National Standards Institute (ANSI), and Information Technology Industry Council(ITI). Not for resale. No part of th
3、is publication may be reproduced in any form, including an electronic retrieval system, withoutthe prior written permission of ITI. All requests pertaining to this standard should be submitted to ITI, 1250 Eye Street NW,Washington, DC 20005.Printed in the United States of AmericaReference numberISO/
4、IEC 14496-10:2003(E)ISO/IEC 2003INTERNATIONAL STANDARD ISO/IEC14496-10First edition2003-12-01Information technology Coding of audio-visual objects Part 10: Advanced video coding Technologies de linformation Codage des objets audiovisuels Partie 10: Codage visuel avanc ISO/IEC 14496-10:2003(E) PDF di
5、sclaimer This PDF file may contain embedded typefaces. In accordance with Adobes licensing policy, this file may be printed or viewed but shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading this file, partie
6、s accept therein the responsibility of not infringing Adobes licensing policy. The ISO Central Secretariat accepts no liability in this area. Adobe is a trademark of Adobe Systems Incorporated. Details of the software products used to create this PDF file can be found in the General Info relative to
7、 the file; the PDF-creation parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below. ISO/IEC 2003
8、 All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISOs member body in the count
9、ry of the requester. ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.org Published in Switzerland ii ISO/IEC 2003 All rights reservedISO/IEC 14496-10:2003(E) ISO/IEC 2003 All rights reserved iiiCONTENTS Foreword.
10、 vii 0 Introduction . viii 0.1 Prologue viii 0.2 Purpose viii 0.3 Applications viii 0.4 Profiles and levels . viii 0.5 Overview of the design characteristics.ix 0.6 How to read this specification.x 1 Scope .1 2 Normative references.1 3 Definitions.1 4 Abbreviations .8 5 Conventions9 5.1 Arithmetic o
11、perators9 5.2 Logical operators.9 5.3 Relational operators 10 5.4 Bit-wise operators .10 5.5 Assignment operators10 5.6 Range notation 10 5.7 Mathematical functions.10 5.8 Variables, syntax elements, and tables11 5.9 Text description of logical operations .12 5.10 Processes .13 6 Source, coded, deco
12、ded and output data formats, scanning processes, and neighbouring relationships.13 6.1 Bitstream formats 13 6.2 Source, decoded, and output picture formats 14 6.3 Spatial subdivision of pictures and slices16 6.4 Inverse scanning processes and derivation processes for neighbours .17 7 Syntax and sema
13、ntics 28 7.1 Method of describing syntax in tabular form 28 7.2 Specification of syntax functions, categories, and descriptors29 7.3 Syntax in tabular form.30 7.4 Semantics 47 8 Decoding process81 8.1 NAL unit decoding process.81 8.2 Slice decoding process 82 8.3 Intra prediction process .100 8.4 In
14、ter prediction process .111 8.5 Transform coefficient decoding process and picture construction process prior to deblocking filter process .133 8.6 Decoding process for P macroblocks in SP slices or SI macroblocks.140 8.7 Deblocking filter process 145 9 Parsing process.155 9.1 Parsing process for Ex
15、p-Golomb codes 155 9.2 CAVLC parsing process for transform coefficient levels .158 9.3 CABAC parsing process for slice data166 Annex A (normative) Profiles and levels .204 A.1 Requirements on video decoder capability204 A.2 Profiles 204 A.3 Levels205 Annex B (normative) Byte stream format.212 B.1 By
16、te stream NAL unit syntax and semantics 212 ISO/IEC 14496-10:2003(E) iv ISO/IEC 2003 All rights reservedB.2 Byte stream NAL unit decoding process 212 B.3 Decoder byte-alignment recovery (informative). 213 Annex C (normative) Hypothetical reference decoder 214 C.4 Operation of coded picture buffer (C
17、PB) 216 C.5 Operation of the decoded picture buffer (DPB) 218 C.6 Bitstream conformance. 219 C.7 Decoder conformance. 221 Annex D (normative) Supplemental enhancement information . 224 D.8 SEI payload syntax . 224 D.9 SEI payload semantics 232 Annex E (normative) Video usability information. 250 E.1
18、0 VUI syntax 250 E.11 VUI semantics 252 Annex F (informative) Patent Rights 262 LIST OF FIGURES Figure 6-1 Nominal vertical and horizontal locations of 4:2:0 luma and chroma samples in a frame 15 Figure 6-2 Nominal vertical and horizontal sampling locations of samples top and bottom fields. 16 Figur
19、e 6-3 A picture with 11 by 9 macroblocks that is partitioned into two slices . 16 Figure 6-4 Partitioning of the decoded frame into macroblock pairs. . 17 Figure 6-5 Macroblock partitions, sub-macroblock partitions, macroblock partition scans, and sub-macroblock partition scans. 18 Figure 6-6 Scan f
20、or 4x4 luma blocks. 19 Figure 6-7 Neighbouring macroblocks for a given macroblock 20 Figure 6-8 Neighbouring macroblocks for a given macroblock in MBAFF frames 21 Figure 6-9 Determination of the neighbouring macroblock, blocks, and partitions (informative) 22 Figure 7-1 The structure of an access un
21、it not containing any NAL units with nal_unit_type equal to 0, 7, 8, or in the range of 12 to 31, inclusive 52 Figure 8-1 Intra_4x4 prediction mode directions (informative) 102 Figure 8-2 Example for temporal direct-mode motion vector inference (informative) 121 Figure 8-3 Directional segmentation p
22、rediction (informative) 122 Figure 8-4 Integer samples (shaded blocks with upper-case letters) and fractional sample positions (un-shaded blocks with lower-case letters) for quarter sample luma interpolation. . 127 Figure 8-5 Fractional sample position dependent variables in chroma interpolation and
23、 surrounding integer position samples A, B, C, and D. . 129 Figure 8-6 Assignment of the indices of dcY to luma4x4BlkIdx. . 134 Figure 8-7 Assignment of the indices of dcC to chroma4x4BlkIdx. . 135 Figure 8-8 a) Zig-zag scan. b) Field scan 135 Figure 8-9 Boundaries in a macroblock to be filtered (lu
24、ma boundaries shown with solid lines and chroma boundaries shown with dashed lines) 145 Figure 8-10 Convention for describing samples across a 4x4 block horizontal or vertical boundary . 148 Figure 9-1 Illustration of CABAC parsing process for a syntax element SE (informative) 167 Figure 9-2 Overvie
25、w of the arithmetic decoding process for a single bin (informative). 193 Figure 9-3 Flowchart for decoding a decision . 194 Figure 9-4 Flowchart of renormalization. 196 Figure 9-5 Flowchart of bypass decoding process. 197 Figure 9-6 Flowchart of decoding a decision before termination 198 Figure 9-7
26、Flowchart for encoding a decision . 199 Figure 9-8 Flowchart of renormalization in the encoder . 200 Figure 9-9 Flowchart of PutBit(B) 200 Figure 9-10 Flowchart of encoding bypass 201 Figure 9-11 Flowchart of encoding a decision before termination 202 ISO/IEC 14496-10:2003(E) ISO/IEC 2003 All rights
27、 reserved vFigure 9-12 Flowchart of flushing at termination 202 Figure C-1 Structure of byte streams and NAL unit streams for HRD conformance checks.214 Figure C-2 HRD buffer model .215 Figure E-1 Location of chroma samples for top and bottom fields as a function of chroma_sample_loc_type_top_field
28、and chroma_sample_loc_type_bottom_field 257 LIST OF TABLES Table 6-1 ChromaFormatFactor values14 Table 6-2 Specification of input and output assignments for subclauses 6.4.7.1 to 6.4.7.5.21 Table 6-3 Specification of mbAddrN.25 Table 6-4 - Specification of mbAddrN and yM 27 Table 7-1 NAL unit type c
29、odes48 Table 7-2 Meaning of primary_pic_type .58 Table 7-3 Name association to slice_type61 Table 7-4 reordering_of_pic_nums_idc operations for reordering of reference picture lists.66 Table 7-5 Interpretation of adaptive_ref_pic_marking_mode_flag .68 Table 7-6 Memory management control operation (m
30、emory_management_control_operation) values .68 Table 7-7 Allowed collective macroblock types for slice_type .70 Table 7-8 Macroblock types for I slices.71 Table 7-9 Macroblock type with value 0 for SI slices .72 Table 7-10 Macroblock type values 0 to 4 for P and SP slices 73 Table 7-11 Macroblock ty
31、pe values 0 to 22 for B slices74 Table 7-12 Specification of CodedBlockPatternChroma values75 Table 7-13 Relationship between intra_chroma_pred_mode and spatial prediction modes 76 Table 7-14 Sub-macroblock types in P macroblocks.77 Table 7-15 Sub-macroblock types in B macroblocks 78 Table 8-1 Refin
32、ed slice group map type 86 Table 8-2 Specification of Intra4x4PredMode luma4x4BlkIdx and associated names 101 Table 8-3 Specification of Intra16x16PredMode and associated names107 Table 8-4 Specification of Intra chroma prediction modes and associated names.109 Table 8-5 Specification of the variabl
33、e colPic .115 Table 8-6 Specification of PicCodingStruct( X ) .116 Table 8-7 Specification of mbAddrCol, yM, and vertMvScale .117 Table 8-8 Assignment of prediction utilization flags.119 Table 8-9 Derivation of the vertical component of the chroma vector in field coding mode.124 Table 8-10 Different
34、ial full-sample luma locations .127 Table 8-11 Assignment of the luma prediction sample predPartLXL xL, yL.129 Table 8-12 Specification of mapping of idx to cijfor zig-zag and field scan .136 Table 8-13 Specification of QPCas a function of qPI136 Table 8-14 Derivation of indexA and indexB from offse
35、t dependent threshold variables and .152 Table 8-15 Value of filter clipping variable tC0as a function of indexA and bS153 Table 9-1 Bit strings with “prefix” and “suffix” bits and assignment to codeNum ranges (informative)155 Table 9-2 Exp-Golomb bit strings and codeNum in explicit form and used as
36、 ue(v) (informative)156 Table 9-3 Assignment of syntax element to codeNum for signed Exp-Golomb coded syntax elements se(v)156 Table 9-4 Assignment of codeNum to values of coded_block_pattern for macroblock prediction modes157 Table 9-5 coeff_token mapping to TotalCoeff( coeff_token ) and TrailingOn
37、es( coeff_token ).160 Table 9-6 Codeword table for level_prefix163 Table 9-7 total_zeros tables for 4x4 blocks with TotalCoeff( coeff_token ) 1 to 7 .164 Table 9-8 total_zeros tables for 4x4 blocks with TotalCoeff( coeff_token ) 8 to 15 .164 Table 9-9 total_zeros tables for chroma DC 2x2 blocks 165
38、ISO/IEC 14496-10:2003(E) vi ISO/IEC 2003 All rights reservedTable 9-10 Tables for run_before 165 Table 9-11 Association of ctxIdx and syntax elements for each slice type in the initialisation process 168 Table 9-12 Values of variables m and n for ctxIdx from 0 to 10. 169 Table 9-13 Values of variabl
39、es m and n for ctxIdx from 11 to 23. 169 Table 9-14 Values of variables m and n for ctxIdx from 24 to 39. 169 Table 9-15 Values of variables m and n for ctxIdx from 40 to 53. 169 Table 9-16 Values of variables m and n for ctxIdx from 54 to 59. 170 Table 9-17 Values of variables m and n for ctxIdx fr
40、om 60 to 69. 170 Table 9-18 Values of variables m and n for ctxIdx from 70 to 104. 170 Table 9-19 Values of variables m and n for ctxIdx from 105 to 165. 171 Table 9-20 Values of variables m and n for ctxIdx from 166 to 226. 172 Table 9-21 Values of variables m and n for ctxIdx from 227 to 275. 173
41、Table 9-22 Values of variables m and n for ctxIdx from 277 to 337. 174 Table 9-23 Values of variables m and n for ctxIdx from 338 to 398. 175 Table 9-24 Syntax elements and associated types of binarization, maxBinIdxCtx, and ctxIdxOffset 177 Table 9-25 Bin string of the unary binarization (informati
42、ve). 178 Table 9-26 Binarization for macroblock types in I slices 180 Table 9-27 Binarization for macroblock types in P, SP, and B slices . 181 Table 9-28 Binarization for sub-macroblock types in P, SP, and B slices. 182 Table 9-29 Assignment of ctxIdxInc to binIdx for all ctxIdxOffset values except
43、 those related to the syntax elements coded_block_flag, significant_coeff_flag, last_significant_coeff_flag, and coeff_abs_level_minus1 184 Table 9-30 Assignment of ctxIdxBlockCatOffset to ctxBlockCat for syntax elements coded_block_flag, significant_coeff_flag, last_significant_coeff_flag, and coef
44、f_abs_level_minus1. 185 Table 9-31 Specification of ctxIdxInc for specific values of ctxIdxOffset and binIdx 191 Table 9-32 Specification of ctxBlockCat for the different blocks . 192 Table 9-33 Specification of rangeTabLPS depending on pStateIdx and qCodIRangeIdx.195 Table 9-34 State transition tab
45、le 196 Table A-1 Level limits. 207 Table A-2 Baseline profile level limits 208 Table A-3 Main profile level limits . 209 Table A-4 Extended profile level limits 209 Table A-5 Maximum frame rates (frames per second) for some example frame sizes 210 Table D-1 Interpretation of pic_struct . 233 Table D
46、-2 Mapping of ct_type to source picture scan. 234 Table D-3 Definition of counting_type values 234 Table D-4 scene_transition_type values 242 Table E-1 Meaning of sample aspect ratio indicator . 252 Table E-2 Meaning of video_format . 253 Table E-3 Colour primaries . 254 Table E-4 Transfer character
47、istics . 255 Table E-5 Matrix coefficients 256 Table E-6 Divisor for computation of tfi,dpb( n ) 258 Table F-1 Organisations providing patent rights licensing notices 262 ISO/IEC 14496-10:2003(E) ISO/IEC 2003 All rights reserved viiForeword ISO (the International Organization for Standardization) an
48、d IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal wi
49、th particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO and IEC have establis
