SMPTE ST 2068-2013 Stereoscopic 3D Frame Compatible Packing and Signaling for HDTV.pdf

1、 Copyright 2013 by THE SOCIETY OF MOTION PICTURE AND TELEVISION ENGINEERS 3 Barker Avenue, White Plains, NY 10601 (914) 761-1100 Approved July 29, 2013 Table of Contents Page Foreword . 2 Intellectual Property 2 Introduction 2 1 Scope . 4 2 Conformance Notation . 4 3 Normative References . 5 4 Defin

2、ition of Terms . 5 5 3DFC Ancillary Data Packet Specification and Carriage 5 Annex A Bibliography (Informative) . 13 Annex B 3D Frame Compatible Packing Methods Graphical Representation (Informative) 14 Page 1 of 15 pages SMPTE ST 2068:2013 SMPTE STANDARD Stereoscopic 3D Frame Compatible Packing and

3、 Signaling for HDTV SMPTE ST 2068:2013 Page 2 of 15 pages Foreword SMPTE (the Society of Motion Picture and Television Engineers) is an internationally-recognized standards developing organization. Headquartered and incorporated in the United States of America, SMPTE has members in over 80 countries

4、 on six continents. SMPTEs Engineering Documents, including Standards, Recommended Practices, and Engineering Guidelines, are prepared by SMPTEs Technology Committees. Participation in these Committees is open to all with a bona fide interest in their work. SMPTE cooperates closely with other standa

5、rds-developing organizations, including ISO, IEC and ITU. SMPTE Engineering Documents are drafted in accordance with the rules given in Part XIII of its Operations Manual. SMPTE ST 2068 was prepared by Technology Committee 10E. Intellectual Property At the time of publication no notice had been rece

6、ived by SMPTE claiming patent rights essential to the implementation of this Standard. However, attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. SMPTE shall not be held responsible for identifying any or all such patent rights. Spe

7、cifically, one or more multiplexing methods signaled by this Standard may be the subject of patent rights. SMPTE shall not be held responsible for identifying any or all such patent rights. Introduction This section is entirely informative and does not form an integral part of this Engineering Docum

8、ent. Stereoscopic 3D imaging systems deliver two images (left eye image and right eye image), that are arranged to be seen simultaneously or near simultaneously by the left and right eyes. Viewers then perceive increased depth in the picture, which becomes more like the natural binocular viewing exp

9、erience. One method of carrying stereoscopic signals in existing 2D HDTV systems is to multiplex two temporally or spatially sub-sampled images of a stereoscopic image pair into a single stream. This method of carriage is called the Frame Compatible packing method. This document provides a mechanism

10、 to signal the packing method used to create a Frame Compatible serial data stream. This signaling is based upon and is compatible with the H.264/MPEG-4 AVC Frame Packing Arrangement SEI message. Annex B Frame Compatible Packing Methods (informative) provides illustrations of the frame packing metho

11、ds covered by this standard. Figure 1 illustrates the process of creating a frame compatible image stream from a Stereoscopic 3D image pair. The general order of operations that occur when two images of a stereoscopic image pair are packed into one frame compatible image are as follows: (1) The inpu

12、t Stereoscopic serial data stream consisting of a stereoscopic image pair (Left Eye image and Right Eye image), as defined for example in SMPTE ST 292-2, Dual 1.5 Gb/s Serial Digital Interface for Stereoscopic Image Transport or SMPTE ST 425-4, Dual 3Gb/s Serial Digital Interface for Stereoscopic Im

13、age Transport, are first decoded into a Full resolution Left eye image (FrLe) and a Full resolution Right eye image (FrRe). The FrLe and FrRe images are then filtered prior to the application of temporal or spatial sub-sampling. SMPTE ST 2068:2013 Page 3 of 15 pages The sub-sampling process produces

14、 two half resolution sub-images Half spatial resolution Left eye / Right eye (HrLe / HrRe), or Half Temporal resolution Left eye / Right eye (HTrLe / HTrRe). These sub images may be half the horizontal, vertical or temporal resolution of the originating full resolution stereoscopic image pair. (2) T

15、he two HrLe and HrRe or HTrLe and HTrRe sub-images are then packed into an intermediate form in preparation for multiplexing into a single Frame Packed Image. The packing step may also format the sub-images by reversing the image orientation or pixel order. The two Frame Packed sub-images are then m

16、ultiplexed together to form the frame packed image. (3) The frame packed image (FpI) is then output as a frame compatible serial data stream in accordance with SMPTE ST 292-1, 1.5 Gb/s Serial Digital Interface or SMPTE ST 425-1, 3 Gb/s Serial Digital Interface. (4) Information describing the sub-sam

17、pling, packing method and multiplexing (Packing Method Signaling), is appended to the frame compatible serial data stream to facilitate interchange of Frame Compatible signals. Frame Packed ImageSpatial or TemporalSub-samplingFrame packingSMPTE ST 292-2 / 425-4Stereoscopic serial data streamPacking

18、Method SignallingSMPTE ST 292-1 / 425-1 Frame Compatible serial data streamHalf resolution Left Eye image(HrLe) / (HTrLe)Full resolution Left Eye Image(FrLe)Full resolution Right eye image(FrRe)Spatial or TemporalSub-samplingHalf resolution Right Eye image(HrRe) / (HTrRe)Figure 1 (Informative) Overv

19、iew of the frame packing operations SMPTE ST 2068:2013 Page 4 of 15 pages 1 Scope This standard defines a 3D Frame Compatible (3DFC) ancillary data packet that enumerates various frame packing methods in a manner compatible with Recommendation ITU-T H.264 (H.264) and ISO/IEC 14496-10 MPEG-4 AVC (MPE

20、G-4 AVC), Frame Packing Arrangement SEI message. This ancillary data packet provides information for the frame compatible transport of 10-bit stereoscopic image pairs (Left eye and Right eye images) as defined in dual 1.5 Gb/s and 3 Gb/s serial digital interfaces for stereoscopic image transport tha

21、t are temporally or spatially sub-sampled and combined to form a frame compatible serial data stream in accordance with 1.5 Gb/s and 3 Gb/s serial digital interfaces. The ancillary data packet is carried in the vertical ancillary (VANC) data space of the frame compatible serial data stream having th

22、e same pixel array structure as the originating stereoscopic image pair, and is used to signal the frame packing method utilized in order to facilitate interchange of Stereoscopic Frame Compatible signals. The information contained in this ancillary data packet could then be used to set the H.264/MP

23、EG-4 AVC Frame Packing Arrangement SEI message prior to delivery to a subsequent transmission delivery device. The precise translation between the 3DFC ancillary data packet and the Frame Packing Arrangement SEI message is not within the scope of this standard. Nor does this standard address other a

24、dditional H.264/MPEG-4 AVC SEI messages that may be required for transmission delivery of a 3D Frame Compatible signal. Definition of the filtering mechanism is not within the scope of this standard since implementers can employ a variety of standard or proprietary filtering methods to improve image

25、 quality. It is not necessary for implementations to include support for all frame packing arrangements defined in Table 4 to conform to this standard. Implementers should indicate supported frame packing arrangements in commercial publications. 2 Conformance Notation Normative text is text that des

26、cribes elements of the design that are indispensable or contains the conformance language keywords: “shall“, “should“, or “may“. Informative text is text that is potentially helpful to the user, but not indispensable, and can be removed, changed, or added editorially without affecting interoperabili

27、ty. Informative text does not contain any conformance keywords. All text in this document is, by default, normative, except: the Introduction, any section explicitly labeled as “Informative“ or individual paragraphs that start with “Note:” The keywords “shall“ and “shall not“ indicate requirements s

28、trictly to be followed in order to conform to the document and from which no deviation is permitted. The keywords, “should“ and “should not“ indicate that, among several possibilities, one is recommended as particularly suitable, without mentioning or excluding others; or that a certain course of ac

29、tion is preferred but not necessarily required; or that (in the negative form) a certain possibility or course of action is deprecated but not prohibited. The keywords “may“ and “need not“ indicate courses of action permissible within the limits of the document. The keyword “reserved” indicates a pr

30、ovision that is not defined at this time, shall not be used, and may be defined in the future. The keyword “forbidden” indicates “reserved” and in addition indicates that the provision will never be defined in the future. SMPTE ST 2068:2013 Page 5 of 15 pages A conformant implementation according to

31、 this document is one that includes all mandatory provisions (“shall“) and, if implemented, all recommended provisions (“should“) as described. A conformant implementation need not implement optional provisions (“may“) and need not implement them as described. Unless otherwise specified, the order o

32、f precedence of the types of normative information in this document shall be as follows: Normative prose shall be the authoritative definition; Tables shall be next; followed by formal languages; then figures; and then any other language forms. 3 Normative References The following standards contain

33、provisions which, through reference in this text, constitute provisions of this standard. At the time of publication, the editions indicated were valid. All standards are subject to revision, and parties to agreements based on this recommended practice are encouraged to investigate the possibility o

34、f applying the most recent edition of the standards indicated below. SMPTE RP 168:2009, Definition of Vertical Interval Switching Point for Synchronous Video Switching SMPTE ST 291-1:2011, Ancillary Data Packet and Space Formatting SMPTE ST 292-1:2012, 1.5 Gb/s Signal/Data Serial Interface SMPTE ST

35、425-1:2011, Source Image Format and Ancillary Data Mapping for the 3 Gb/s Serial Interface 4 Definition of Terms 4.1 Frame Compatible For the purposes of this standard, a frame compatible serial data stream means that the left-eye and right-eye images of a stereoscopic image pair are arranged in a s

36、patial or temporal multiplex which results in a single image stream that can be treated like a conventional 2D serial data stream. The frame compatible serial data stream may be progressive, interlaced or progressive segmented frame in accordance with the format of the originating stereoscopic image

37、 pair. 5 3DFC Ancillary Data Packet Specification and Carriage 5.1 Format of the Ancillary Data Packet The 3DFC Ancillary Data Packet shall be a Type 2 ANC packet as defined in SMPTE ST 291-1. It consists of the ancillary data flag (ADF), the data ID (DID), the secondary data ID (SDID), the data cou

38、nt (DC), the user data words (UDW), and the checksum (CS). The UDW consists of the data payload that describes the Frame Packing method employed for the frame compatible transport of the stereoscopic image pair. The DID word shall be set to the value 41h. The SDID word shall be set to the value of 0

39、Ah. DC is a count of the number of words in the UDW and shall be set to a fixed value of 03h. 5.2 Location and Timing of the Ancillary Data Packet The 3DFC Ancillary Data Packet shall be located in the active line portion of the vertical ancillary space of the frame compatible serial data stream, in

40、 accordance with the image formats referenced by SMPTE ST 292-1, or SMPTE ST 425-1. Data may be located in any lines in the VANC area from the second line after the line specified for switching, as defined in SMPTE RP 168, to the last line before active video, inclusive. SMPTE ST 2068:2013 Page 6 of

41、 15 pages The 3DFC Ancillary Data Packet shall describe the Frame Packing method employed for the current frame of the frame compatible serial data stream. The packet shall be located in the luma (Y) data channel, for SMPTE ST 292-1 compliant frame compatible data streams. The packet shall be mapped

42、 in accordance with the ancillary data mapping rules defined in SMPTE ST 425-1 for a frame compatible data stream compliant with SMPTE ST 425-1. For interlaced video systems, the data packets shall be placed in the VANC area of the first field and in the VANC area of the second field. For progressiv

43、e segmented frame systems, the data packets shall be placed in the VANC area of the first segment of the frame and may be in the VANC area of the second segment. For progressive formats, the ANC packet shall be placed in the VANC area of the frame. Receiving equipment should identify the ANC packets

44、 on the basis of their ANC DID and SDID fields. 5.3 UDW Format Three bytes of Frame Compatible signaling data shall be carried in the User Data Words of the 3DFC ancillary data packet as shown in Table 1. The UDW shall be a sequence of three 10-bit words, and the Frame Compatible signaling data is t

45、ransmitted in bits b7 through b0 of the 10-bit data word. Bit b8 is even parity for bits b7 through b0 of the 10-bit data word, and bit b9 equals the complement of bit b8. Table 1 ANC data payload User Data Words User Data Word bits UDW Function b9 b8 b7 b6 b5 b4 b3 b2 b1 b0 1 FC UDW 1 b8 P fpa3 fpa

46、2 fpa1 fpa0 QSF FPS sv1 sv0 2 GRID Position b8 P f1y1 f1y0 f1x1 f1x0 f0y1 f0y0 f0x1 f0x0 3 FC UDW 3 b8 P sf1 sf0 ci1 ci0 0 SP CFR FV where: sv1, sv0 is the Syntax Version code as defined in Table 2 FPS is the Frame Packed Flag as defined in Table 3 QSF is the Quincunx Sampling Flag as defined in Tab

47、le 5 fpa3 - fpa0 is the Frame Packing Arrangement code as defined in Table 4 f0x1, f0x0 is the HrLe sample Position X as defined in Table 7 f0y1, f0y0 is the HrLe sample Position Y as defined in Table 8 f1x1, f1x0 is the HrRe sample Position X as defined in Table 9 f1y1, f1y0 is the HrRe sample Posi

48、tion Y as defined in Table 10 FV is the Field Views Flag as defined in 5.5.1 CFR is the Current Frame Reference Flag as defined in Table 14 SP is the Sampling Phase flag as defined in Table 6 ci1, ci0 is the Content Interpretation Type as defined in Table 12 sf1, sf0 is the Spatial Flipping Type as

49、defined in Table 13 P is the even parity bit for b7 through b0 SMPTE ST 2068:2013 Page 7 of 15 pages 5.3.1 Syntax Version (sv1-sv0) b1:b0 UDW 1 Two bits in the UDW1 byte are used to signal different versions of the mapping syntax for the ancillary data packet to decoding devices. Bit 0 shall be set to zero and bit 1 shall be set to zero for the mapping syntax described in this standard. Table 2 Syntax Version sv1 sv0 Frame Reference 0 0 Syntax version 0 (Current) 0 1 Reserved 1 0 Reserved 1 1 Reserved 5.3.2 Frame Packed Signal (FPS)