SMPTE RDD 35-2016 TICO Lightweight Codec Used in IP Networked or in SDI Infrastructures.pdf

1、 Copyright 2016 by THE SOCIETY OF MOTION PICTURE AND TELEVISION ENGINEERS 3 Barker Avenue, White Plains, NY 10601 (914) 761-1100 Approved March 24, 2016 The attached document is a Registered Disclosure Document prepared by the sponsor identified below. It has been examined by the appropriate SMPTE T

2、echnology Committee and is believed to contain adequate information to satisfy the objectives defined in the Scope, and to be technically consistent. This document is NOT a Standard, Recommended Practice or Engineering Guideline, and does NOT imply a finding or representation of the Society. Errors

3、in this document should be reported to the proponent identified below, with a copy to engsmpte.org. All other inquiries in respect of this document, including inquiries as to intellectual property requirements that may be attached to use of the disclosed technology, should be addressed to the propon

4、ent identified below. Proponent contact information: Jean-Baptiste Lorent intoPIX SA Rue Emile Francqui, 9 1435 Mont-Saint-Guibert BELGIUM Email: Page 1 of 53 pages SMPTE RDD 35:2016 SMPTE REGISTERED DISCLOSURE DOCUMENT TICO Lightweight Codec Used in IP Networked or in SDI Infrastructures SMPTE RDD

5、 35:2016 Page 2 of 53 pages Table of Contents Page Introduction 3 1 Scope 4 2 Normative References 4 3 TICO Compression . 5 3.1 Notation 5 3.1.1 Mathematical Operators 5 3.1.2 Terms and Definitions 6 3.2 TICO Characteristics Overview 7 3.2.1 Lightweight, High Quality and Low Latency in Software and

6、Hardware 7 3.2.2 Encoding / Decoding Block Diagram . 7 3.3 Picture Structure . 8 3.4 Bitstream Syntax 9 3.4.1 Overview 9 3.4.2 Picture Syntax 10 3.4.3 Slice Syntax . 11 3.4.4 Precinct Syntax 12 3.5 Bitstream Semantics . 13 3.5.1 Picture Header Semantics . 13 3.5.2 Slice Semantics . 16 3.5.3 Precinct

7、 Semantics 16 3.5.4 Precinct Header Semantics . 16 3.6 Decoding Process 18 3.6.1 Decoding Summary . 18 3.6.2 Precinct Decoding 20 4 TICO Bitstream Mapping 31 4.1 Video Essence Box 31 4.1.1 Introduction 31 4.1.2 Video Essence Box Syntax . 31 4.1.3 Video Essence Box Semantics 32 4.2 TICO Mapping to Ac

8、tive Video Area of 3G-SDI . 39 4.2.1 Overview 39 4.2.2 3G-SDI container . 39 4.2.3 Active Area with new TICO transported data 40 4.2.4 TICO Mapped in SDI with SMPTE ST 2022-5/6/7 44 4.3 TICO Mapping to RTP 45 Annex A RAND IP Licensing . 47 Annex B Complementary Pseudo Code (Informative) 48 B.1 Coded

9、 Packets Decoding Pseudo Code . 48 B.2 Raw Data Packet Unpacking Pseudo Code . 50 Annex C IANA Considerations (Informative) . 52 Annex D Bibliography (Informative) . 53 SMPTE RDD 35:2016 Page 3 of 53 pages Introduction TICO is a video compression scheme developed by intoPIX SA, which stands for Tiny

10、 Codec. TICO answers the need for a low latency and light weight visually lossless mezzanine compression to manage and carry UHDTV format across 3G-SDI and IP networks in production workflows. TICO can compress image data up to 10240 H x 10240 W x 12 bit per components. This SMPTE RDD describes the

11、TICO bitstream, the decoding process, the provisions for mapping bitstreams onto a single 3G-SDI link and the provisions for mapping bitstreams onto an IP network. Figure 1 TICO SMPTE RDD 35 scope This SMPTE RDD contains sufficient information for knowledgeable individuals to build an implementation

12、. An important feature of this mapping process is that it can be implemented in a practical form using currently available firmware and hardware. In the course of time, it could be implemented within new chip designs to ensure the minimum impact on hardware power requirements and physical size. Note

13、: “TICO” is trademark of intoPIX SA. SMPTE RDD 35:2016 Page 4 of 53 pages 1 Scope This Registered Disclosure Document (RDD): provides specification on TICO compression; specifies a TICO bitstream syntax containing information for interpreting the compressed image data; specifies TICO decoding proces

14、ses for converting compressed image data to reconstructed image data based on TICO profile 2; specifies TICO bitstream mapping and detection in 3G-SDI environments (including protecting the EAV/SAV codes); specifies TICO bitstream mapping in IP networks with RTP mapping. 2 Normative References Note:

15、 All references in this document to other SMPTE documents use the current numbering style (e.g. SMPTE ST 274:2008) although, during a transitional phase, the document as published (printed or PDF) may bear an older designation (such as SMPTE 274M-2008). Documents with the same root number (e.g. 274)

16、 and publication year (e.g. 2008) are functionally identical. The following standards contain provisions which, through reference in this text, constitute provisions of this Registered Disclosure Document (RDD). At the time of publication, the editions indicated were valid. All standards are subject

17、 to revision, and parties to agreements based on this RDD are encouraged to investigate the possibility of applying the most recent editions of the standards listed below. SMPTE ST 12-2:2014, Transmission of Time Code in the Ancillary Data Space SMPTE ST 274:2008, Television 1920 x 1080 Image Sample

18、 Structure, Digital Representation and Digital Timing Reference Sequences for Multiple Picture Rates SMPTE ST 291-1:2011, Ancillary Data Packet and Space Formatting SMPTE ST 292-1:2012,1.5 Gb/s Signal/Data Serial Interface SMPTE ST 299-1:2009, 24-Bit Digital Audio Format for SMPTE 292 Bit-Serial Int

19、erface SMPTE ST 299-2:2010, Extension of the 24-Bit Digital Audio Format to 32 Channels for 3 Gb/s Bit-Serial Interfaces SMPTE ST 352:2013, Payload Identification Codes for Serial Digital Interfaces SMPTE ST 424:2012, 3 Gb/s Signal/Data Serial Interface SMPTE ST 425-1:2014, Source Image Format and A

20、ncillary Data Mapping for the 3 Gb/s Serial Interface SMPTE ST 425-3:2015, Image Format and Ancillary Data Mapping for the Dual Link 3 Gb/s Serial Interface SMPTE ST 425-5:2015, Image Format and Ancillary Data Mapping for the Quad Link 3 Gb/s Serial Interface SMPTE ST 2022-6:2012, Transport of High

21、Bit Rate Media Signals Over IP Networks (HBRMT) SMPTE ST 2059-1:2015, Generation and Alignment of Interface Signals to the SMPTE Epoch SMPTE RDD 35:2016 Page 5 of 53 pages SMPTE ST 2081-10:2015, 2160-Line and 1080-Line Source Image and Ancillary Data Mapping for Single Link 6G-SDI SMPTE ST 2082-10:2

22、015, 2160-Line Source Image and Ancillary Data Mapping for 12G-SDI SMPTE ST 2084:2014, High Dynamic Range Electro-Optical Transfer Function of Mastering Reference Displays. Recommendation ITU-R BT.601-7 (03/2011), Studio Encoding Parameters of Digital Television for Standard 4:3 and Wide-Screen 16:9

23、 Aspect Ratios. Recommendation ITU-R BT.709-6 (06/2015), Parameter Values for the HDTV Standards for Production and International Programme Exchange. Recommendation ITU-R BT.2020-2 (10/2015), Parameter Values for Ultra-High Definition Television Systems for Production and International Programme Exc

24、hange. 3 TICO Compression 3.1 Notation 3.1.1 Mathematical Operators 3.1.1.1 Arithmetic Operators + Addition Subtraction (as a binary operator) or negation (as a unary prefix operator) * Multiplication Division (used in mathematical equations where no truncation or rounding is intended) / Integer div

25、ision with truncation of the result toward negative infinity: x / y = floor(x y) n mod m Modulo operator with modulus m. Defined only for integers n and m with m 0. Result is remainder r after integer division of n by m, r = n floor(n m) * m; 0 r m 1. Right shift = Assignment + Increment by one up).

26、 Max(x) Maximum of x. Returns the maximum value 3.1.2 Terms and Definitions 3.1.2.1 Bitstream Compressed image data using TICO compression. (For details, see section 3.3 Picture Structure). 3.1.2.2 Bit-plane A one dimensional array of bits. A bit-plane refers to all the bits of the same position in

27、a group of 4 consecutive binary-coded coefficients with a sign magnitude representation. 3.1.2.3 Coefficient The values that are result of a wavelet transformation. 3.1.2.4 Component (comp) A two-dimensional array of samples having the same designation in the output or display device. An image typic

28、ally consists of several components, e.g. red, green and blue. 3.1.2.5 Decomposition level A collection of wavelet sub-bands where each coefficient has the same spatial impact or span with respect to the source component samples. 3.1.2.6 Greatest Coded Line Index (GCLI) Index of the most significant

29、 non-null bit-plane 3.1.2.7 Greatest Trimmed Line Index (GTLI) Number of trimmed bits for a sub-band at a certain iteration 3.1.2.8 Picture A segment of bitstream for one frame or field. 3.1.2.9 Precinct A 2-pixel lines region of a transformed component, used as compression unit for limiting the siz

30、e of packets. 3.1.2.10 Precision Number of bits allocated to a particular sample, coefficient, or other binary numerical representation. SMPTE RDD 35:2016 Page 7 of 53 pages 3.1.2.11 Quantization A method of reducing the precision of the individual coefficients to reduce the number of bits used to e

31、ntropy code them. This is equivalent to division while compressing and multiplication while decompressing. Quantization can be achieved by an explicit operation with a given quantization value. 3.1.2.12 Sign-magnitude Binary representation of an integer value, starting with 1 sign bit (0 for positiv

32、e integer, 1 for negative integer). The remaining bits in the number indicate the magnitude (or absolute value). 3.1.2.13 Sub-band (sb) A group of transform coefficients from the same component resulting from the same sequence of low-pass and high-pass filtering operations, both vertically and horiz

33、ontally. 3.2 TICO Characteristics Overview 3.2.1 Lightweight, High Quality and Low Latency in Software and Hardware TICO algorithm offers simultaneously low complexity (in hardware and software), low latency and visually lossless quality at low compression ratio (typically 4:1). Image quality : The

34、compression scheme provides visually lossless compression and is robust to multiple encoding generations. The compression can be mathematically lossless at low compression rate due to the use of the 5/3 wavelet for lossless (reversible) transform. The rate control mechanisms are guaranteeing an opti

35、mal quality within each precinct using contrast sensitivity function (CSF) for an optimal visual weighting and optimal transfer between precincts. TICO outputs at a constant bitrate (CBR) for an optimal quality. Low latency: Due to its line-based wavelet transforms and entropy coding, a hardware imp

36、lementation can achieve a latency of few lines of pixels for the encoding or decoding process. The latency is also fixed. With parallel processing, a software (CPU) implementation can achieve a single frame of latency for the encoding or decoding process. Lightweight and low power in hardware: TICO

37、should not require any external memory when implemented in a FPGA ( numerical values appear most-significant bit first. SMPTE RDD 35:2016 Page 10 of 53 pages Table 1 Categories of syntax elements Categories of syntax elements Notation Fixed-length bit strings where n is the number of bits in the str

38、ing f(n) Fixed-length numerical values. unsigned integers where n is the number of bits used to represent the value u(n) Variable-length bit strings. V is a variable name used to refer to that length (expressed in bits) in the rest of this section. vl(V) The syntax element descriptions tables have t

39、hree columns. The first column shows the name of the syntax element. The second column indicates the category of the syntax element as defined in Table 1. The third column may contain an abbreviation used to refer to the value of the syntax element in the rest of this section. Figure 5 gives an over

40、view of the hierarchy of TICO bitstream syntax structures. Figure 5 TICO bitstream syntax structure hierarchy 3.4.2 Picture Syntax Table 2 Picture Syntax Picture() vl( VL_P ) picture_header() vl( VL_PHD ) k Slices() (k=ceil(PVS/SH) vl( VL_SL ) SMPTE RDD 35:2016 Page 11 of 53 pages 3.4.2.1 Picture He

41、ader Syntax Table 3 Picture Header Syntax picture_header() vl( VL_PHD ) picture_identifier f(32)= TICO header_length u(8) PHDL reserved u(24) horizontal_size u(16) PHS vertical_size u(16) PVS color_difference _subsampling u(4) bit_depth u(4) reserved u(24) encoder_identifier u(32) bitstream_length u

42、(32) BSL bitstream_profile u(4) Cbr u(1) color_transform u(3) hor_decomposition_number u(4) ver_decompostion_number u(4) dq_type u(1) reserved u(15) slice_height u(16) SLH reserved u(16) lvl_weights u(16*36) reserved u(192) reserved_optional vl( VL_PHRO ) 3.4.3 Slice Syntax Table 4 Slice Syntax Slic

43、e() vl( VL_S ) Multiple Precincts vl( VL_MP ) slice_length u(24) SL SMPTE RDD 35:2016 Page 12 of 53 pages 3.4.4 Precinct Syntax Table 5 Precinct Syntax Precinct() vl(VL_P) precinct_header u(40) coded_data_length_marker (line 0) u(16) CDL0 coded_data_packet (line 0) Components are scanned one after t

44、he other: comp0, comp1, comp2 Inside components, the horizontal decomposition levels are packed one after the other: Lvl0, Lvl1, Lvl2, Lvl3, Lvl4, Lvl5 vl(VL_CD0) coded_data padding vl(VL_CDP0) raw_data_length_marker (line 0) u(20) RDL0 raw_data_packet (line 0) Components are packed one after the ot

45、her: comp0, comp1, comp2 Inside components, the horizontal decomposition levels are packed one after the other: Lvl0, Lvl1, Lvl2, Lvl3, Lvl4, Lvl5 vl(VL_RD0) coded_data_length_marker (line 1) u(16) CDL1 coded_data_packet (line 1) Components are scanned one after the other: comp0, comp1, comp2 Inside

46、 components, the horizontal decomposition levels are packed one after the other: Lvl0, Lvl1, Lvl2, Lvl3, Lvl4, Lvl5 vl(VL_CD1) coded_data padding vl(VL_CDP1) raw_data_length_marker (line 1) u(20) RDL1 raw_data_packet (line 1) Components are packed one after the other: comp0, comp1, comp2 Inside comp

47、onents, the horizontal decomposition levels are packed one after the other: Lvl0, Lvl1, Lvl2, Lvl3, Lvl4, Lvl5 vl(VL_RD1) precinct_padding vl(VL_PP) 3.4.4.1 Precinct Header Syntax Table 6 Precinct Header Syntax Precinct_header() u(40) precinct_length_marker u(20) PL truncation_scenario u(4) truncati

48、on_refinement u(8) GCLI_coding_mode u(4) reserved u(4) SMPTE RDD 35:2016 Page 13 of 53 pages 3.5 Bitstream Semantics 3.5.1 Picture Header Semantics picture_identifier A four-character ASCII code that shall identify the bitstream as a TICO picture. This shall be TICO value. Byte sequence is: 5449434F

49、 header_length An 8-bit integer that shall contain the length in bytes of the whole picture header. It is greater than or equal to 128. PHDL = (VL_PHD / 8). The length of the optional_reserved field can be calculated from this variable. VL_PHRO = 8*(PHDL 128) horizontal_size horizontal_size shall be the width of the picture in luma samples. vertical_size vertical_size shall be the height of the picture in luma samples. color_difference_subsampling color_difference_su