ANSI IEEE 1857-2013 Advanced Audio and Video Coding (IEEE Computer Society).pdf

1、 IEEE Standard for Advanced Audio and Video Coding Sponsored by the Standards Activities Board IEEE 3 Park Avenue New York, NY 10016-5997 USA 4 June 2013 IEEE Computer Society IEEE Std 1857-2013IEEE Std 1857-2013 IEEE Standard for Advanced Audio and Video Coding Sponsor Standards Activities Board of

2、 the IEEE Computer Society Approved 6 March 2013 IEEE-SA Standards Board Recognized as an American National StandardAbstract: In this standard, a set of tools for efficient video coding is defined, including directional intra prediction, variable block size inter prediction and context adaptive bina

3、ry arithmetic coding, and the corresponding decoding procedure. The target applications and services include but not limited TV over Internet, user-generated multimedia content, IP-based video conference, IP-based surveillance, and other video/audio enabled services and applications such as digital

4、television broadcasting, digital storage media, and communication. Keywords: block, coefficients, decoding, encoding, entropy coding, field, frame, IEEE 1857TM, image, Internet Protocol television (IPTV), inter prediction, intra prediction, macroblock, picture, quantization, slice, transform The Ins

5、titute of Electrical and Electronics Engineers, Inc. 3 Park Avenue, New York, NY 10016-5997, USA Copyright 2013 by The Institute of Electrical and Electronics Engineers, Inc. All rights reserved. Published 4 June 2013. Printed in the United States of America. IEEE is a registered trademark in the U.

6、S. Patent +1 978 750 8400. Permission to photocopy portions of any individual standard for educational classroom use can also be obtained through the Copyright Clearance Center. iv Copyright 2013 IEEE. All rights reserved. Notice to users Laws and regulations Users of IEEE Standards documents should

7、 consult all applicable laws and regulations. Compliance with the provisions of any IEEE Standards document does not imply compliance to any applicable regulatory requirements. Implementers of the standard are responsible for observing or referring to the applicable regulatory requirements. IEEE doe

8、s not, by the publication of its standards, intend to urge action that is not in compliance with applicable laws, and these documents may not be construed as doing so. Copyrights This document is copyrighted by the IEEE. It is made available for a wide variety of both public and private uses. These

9、include both use, by reference, in laws and regulations, and use in private self-regulation, standardization, and the promotion of engineering practices and methods. By making this document available for use and adoption by public authorities and private users, the IEEE does not waive any rights in

10、copyright to this document. Updating of IEEE documents Users of IEEE Standards documents should be aware that these documents may be superseded at any time by the issuance of new editions or may be amended from time to time through the issuance of amendments, corrigenda, or errata. An official IEEE

11、document at any point in time consists of the current edition of the document together with any amendments, corrigenda, or errata then in effect. In order to determine whether a given document is the current edition and whether it has been amended through the issuance of amendments, corrigenda, or e

12、rrata, visit the IEEE-SA Website at http:/standards.ieee.org/index.html or contact the IEEE at the address listed previously. For more information about the IEEE Standards Association or the IEEE standards development process, visit IEEE-SA Website at http:/standards.ieee.org/index.html. Errata Erra

13、ta, if any, for this and all other standards can be accessed at the following URL: http:/standards.ieee.org/findstds/errata/index.html. Users are encouraged to check this URL for errata periodically. v Copyright 2013 IEEE. All rights reserved. Patents Attention is called to the possibility that impl

14、ementation of this standard may require use of subject matter covered by patent rights. By publication of this standard, no position is taken by the IEEE with respect to the existence or validity of any patent rights in connection therewith. If a patent holder or patent applicant has filed a stateme

15、nt of assurance via an Accepted Letter of Assurance, then the statement is listed on the IEEE-SA Website at http:/standards.ieee.org/about/sasb/patcom/patents.html. Letters of Assurance may indicate whether the Submitter is willing or unwilling to grant licenses under patent rights without compensat

16、ion or under reasonable rates, with reasonable terms and conditions that are demonstrably free of any unfair discrimination to applicants desiring to obtain such licenses. Essential Patent Claims may exist for which a Letter of Assurance has not been received. The IEEE is not responsible for identif

17、ying Essential Patent Claims for which a license may be required, for conducting inquiries into the legal validity or scope of Patents Claims, or determining whether any licensing terms or conditions provided in connection with submission of a Letter of Assurance, if any, or in any licensing agreeme

18、nts are reasonable or non-discriminatory. Users of this standard are expressly advised that determination of the validity of any patent rights, and the risk of infringement of such rights, is entirely their own responsibility. Further information may be obtained from the IEEE Standards Association.

19、vi Copyright 2013 IEEE. All rights reserved. Participants At the time this IEEE standard was completed, the Audio Video Coding Working Group had the following membership: Wen Gao, Chair Cliff Reader, Vice Chair Xiaopeng Fan Yun He Tiejun Huang Xiangyang Ji Guoping Li Fan Liang Jian Lou Yan Lu Siwei

20、Ma Qiang Wang Ronggang Wang Zhenyu Wang Feng Wu Lianhuan Xiong Lu Yu Zhihua Zeng Li Zhang Xianguo Zhang Haiwu Zhao Jianhua Zheng Xiaozhen Zheng The following members of the individual balloting committee voted on this standard. Balloters may have voted for approval, disapproval, or abstention. Oscar

21、 Au Jianfei Cai Juan Carreon Jianwen Chen Xilin Chen Keith Chow Sharon Chuang Giovanni Cordara Ray Davis Wenpeng Ding Weibei Dou P. Eastman Andrew Fieldsend Wen Gao Matthew Goldman Randall Groves Zongming Guo Yun He Werner Hoelzl Ruimin Hu Yongli Hu Qingming Huang Tiejun Huang Longshe Huo Noriyuki I

22、keuchi Akio Iso Euee Seon Jang Junzhong Ji Xiangyang Ji Huizhu Jia Feng Jiang Ming Jiang Shuqiang Jiang Tingting Jiang Hui Jin Piotr Karocki Alex Kot Gwo Lee Houqiang Li Jia Li Jinghua Li Weiping Li Fan Liang Weisi Lin Jiaying Liu William Lumpkins Chong Luo Greg Luri Siwei Ma Wei Ma Luntian Mou Mich

23、ael S. Newman Charles Ngethe Xingde Pan Xiulian Peng Ulrich Pohl Honggang Qi Lei Qin Lai-Yun Qing Cliff Reader Benjamin Rolfe Bartien Sayogo Guangming Shi Yunhui Shi Haiyan Shu Walter Struppler Li Su Hui-Fang Sun Jiande Sun Jun Sun Yanfeng Sun Yonghong Tian John Vergis David Virette Dong Wang Lichun

24、 Wang Ronggang Wang Ruiping Wang Shaofan Wang Shuhui Wang Xushu Wang Forrest Wright Feng Wu Xiaolin Wu Jun Xin Hongkai Xiong Ruiqin Xiong Zhiwei Xiong Xiaokang Yang Hongxun Yao Baocai Yin Haoping Yu Li Yu Lu Yu Junsong Yuan Oren Yuen Chen-Xiong Zhang Chunjie Zhang Li Zhang Xinggong Zhang Yong Zhang

25、Zhebin Zhang Debin Zhao Xiaozhen Zheng Daidi Zhong Huan Zhou Wenwu Zhu vii Copyright 2013 IEEE. All rights reserved. When the IEEE-SA Standards Board approved this standard on 6 March 2013, it had the following membership: John Kulick, Chair David J. Law, Vice Chair Richard H. Hulett, Past Chair Kon

26、stantinos Karachalios, Secretary Masayuki Ariyoshi Peter Balma Farooq Bari Ted Burse Wael William Diab Stephen Dukes Jean-Philippe Faure Alexander Gelman Mark Halpin Gary Hoffman Paul Houz Jim Hughes Michael Janezic Joseph L. Koepfinger* Oleg Logvinov Ron Petersen Gary Robinson Jon Walter Rosdahl Ad

27、rian Stephens Peter Sutherland Yatin Trivedi Phil Winston Yu Yuan *Member Emeritus Also included are the following nonvoting IEEE-SA Standards Board liaisons: Richard DeBlasio, DOE Representative Michael Janezic, NIST Representative Julie Alessi IEEE Standards Program Manager, Document Development M

28、alia Zaman IEEE Standards Program Manager, Technical Program Development viii Copyright 2013 IEEE. All rights reserved. Introduction This introduction is not part of IEEE Std 1857-2013, IEEE Standard for Advanced Audio and Video Coding. This standard provides regular high-quality and efficient codin

29、g tool sets for compression, decompression, and packaging of video data to save storage space or bandwidth for transmission over the Internet. ix Copyright 2013 IEEE. All rights reserved. Contents 1. Overview 1 1.1 Scope . 1 1.2 Purpose 1 1.3 Applications . 2 1.4 Profiles and levels 2 1.5 Overview o

30、f the design characteristics 2 1.6 Predictive coding . 2 1.7 Picture partitioned into macroblocks and smaller partitions 3 1.8 Transform and quantization . 3 2. Normative references 3 3. Definitions, acronyms, and abbreviations 3 3.1 Definitions . 3 3.2 Acronyms and abbreviations . 7 4. Operators an

31、d mathematical functions . 8 4.1 Description 8 4.2 Arithmetic operators 8 4.3 Logical operators . 8 4.4 Relational operators . 8 4.5 Bit-wise operators 9 4.6 Assignment operators 9 4.7 Mathematical functions . 10 4.8 Structure relation . 10 5. Description method of bitstream syntax, parsing process,

32、 and decoding process 11 5.1 Description style 11 5.2 Functions . 12 5.3 Descriptors . 13 5.4 Reserved, forbidden, and marker . 14 6. Structure of coded bitstream . 14 6.1 Sequence 15 6.2 Picture 15 6.3 Slices 19 6.4 Macroblock 22 6.5 8 8 Block 22 6.6 4 4 Block 23 7. Bitstream syntax and semantics 2

33、4 7.1 Syntax description . 24 7.2 Semantics description 35 8. Parsing process . 57 8.1 kth-order Exp-Golomb codes 57 8.2 ue(v), se(v), me(v), and me4(v) . 57 8.3 ce(v) and ce4(v) . 60 8.4 ae(v) . 63 x Copyright 2013 IEEE. All rights reserved. 9. Decoding process 76 9.1 High-level syntax structures 7

34、6 9.2 Picture header decoding . 76 9.3 Slice decoding 79 9.4 Macroblock decoding 80 9.5 Block decoding .104 9.6 Quantization coefficients prediction .109 9.7 Inverse quantization 112 9.8 Inverse transform 114 9.9 Intra prediction .116 9.10 Inter prediction .122 9.11 Reconstruction 135 9.12 Loop filt

35、er .136 Annex A (normative) Start code emulation .141 Annex B (normative) Profiles and levels .142 Annex C (normative) Bitstream buffer verifier .149 Annex D (normative) Variable-length code tables 155 1 Copyright 2013 IEEE. All rights reserved. IEEE Standard for Advanced Audio and Video Coding IMPO

36、RTANT NOTICE: IEEE Standards documents are not intended to ensure safety, health, or environmental protection, or ensure against interference with or from other devices or networks. Implementers of IEEE Standards documents are responsible for determining and complying with all appropriate safety, se

37、curity, environmental, health, and interference protection practices and all applicable laws and regulations. This IEEE document is made available for use subject to important notices and legal disclaimers. These notices and disclaimers appear in all publications containing this document and may be

38、found under the heading “Important Notice” or “Important Notices and Disclaimers Concerning IEEE Documents.” They can also be obtained on request from IEEE or viewed at http:/standards.ieee.org/ IPR/disclaimers.html. 1. Overview 1.1 Scope This standard defines a set of tools for efficient video codi

39、ng and the corresponding decoding procedure, including intraprediction, interprediction, transform, quantization, and entropy coding. 1.2 Purpose This standard provides efficient coding tool sets for compression, decompression, and packaging of the video data to save the storage space and the bandwi

40、dth for transmission over the Internet. The target applications and services include but are not limited to Internet Protocol television (IPTV), IP-based video conference, IP-based surveillance, user-generated multimedia content, and other video/audio-enabled services and applications such as digita

41、l television broadcasting, digital storage media, and communication. IEEE Std 1857-2013 IEEE Standard for Advanced Audio and Video Coding 2 Copyright 2013 IEEE. All rights reserved. 1.3 Applications This standard is designed to cover a broad range of applications, including but not limited to, the f

42、ollowing: CATV cable TV on optical networks, copper, etc. DBS direct broadcast satellite video services DSL digital subscriber line video services DTTB digital terrestrial television broadcasting IPTV Internet Protocol television ISM interactive storage media (optical disks, etc.) MMM multimedia mai

43、ling MSPN multimedia services on packet networks RTC real-time conversational services (videoconferencing, videophone, etc.) RVS remote video surveillance 1.4 Profiles and levels This standard can serve a wide range of bit rates, resolutions, and qualities. Considering the capability of interoperati

44、on, a limited number of subsets of the syntax are stipulated by means of “profiles” and “levels.” A “profile” is a subset of the syntax elements, semantics, and algorithmic features of this standard. A “level” is a specified set of limits on the syntax elements and the values that may be taken by th

45、e syntax elements of a certain profile. 1.5 Overview of the design characteristics In this standard, a number of techniques may be used to achieve highly efficient compression, including intra coding, inter coding, transform, quantization, and entropy coding. Intra coding uses various spatial predic

46、tion modes to exploit the spatial statistical dependencies in the source signal of one picture. Inter coding uses motion vectors for block-based inter prediction to exploit the temporal statistical dependencies between the different pictures. The prediction residual is then further compressed throug

47、h using a transform to remove spatial correlation inside the transform block before it is quantized. Quantization is an irreversible process that typically discards less important visual information and provides a close approximation to the source samples. Finally, the intra prediction modes or moti

48、on vectors are transmitted with the quantization coefficients and encoded by entropy coding. 1.6 Predictive coding Intra coding need not refer to other pictures, and intra coded pictures can provide random access points to the coded sequence. Inter coding refers to prior coded pictures, and the orde

49、r of the decoding process can be different from the order of the source picture capture process or the output order for display. In inter coding, motion vector precision can be up to 1/4 or 1/8 pixel, and motion vectors are coded by predictive coding. IEEE Std 1857-2013 IEEE Standard for Advanced Audio and Video Coding 3 Copyright 2013 IEEE. All rights reserved. 1.7 Picture partitioned into macroblocks and smaller partitions In this standard, the basic processing unit of the video decoding process is a macroblock, which consists of a 16 16 block of luma