ITU-T J 603-2011 Real-time transmission system for signals of an expanded hierarchy of large screen digital imagery using spatial image segmentation for parallel processing (Study .pdf

1、 International Telecommunication Union ITU-T J.603TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU (04/2011) SERIES J: CABLE NETWORKS AND TRANSMISSION OF TELEVISION, SOUND PROGRAMME AND OTHER MULTIMEDIA SIGNALS Transport of Large Screen Digital Imagery Real-time transmission system for signals of an

2、expanded hierarchy of large screen digital imagery using spatial image segmentation for parallel processing Recommendation ITU-T J.603 Rec. ITU-T J.603 (04/2011) i Recommendation ITU-T J.603 Real-time transmission system for signals of an expanded hierarchy of large screen digital imagery using spat

3、ial image segmentation for parallel processing Summary Recommendation ITU-T J.603 specifies the function components required to configure a real-time expanded hierarchy of large screen digital imagery (exLSDI) transmission system using spatial image segmentation for parallel processing. The transmis

4、sion system is designed to maintain conformance with the network service operators requirements specified in Recommendation ITU-T J.602. The system comprises of multiple video codec function units of any coding standards. The transmission system also enables flexible adaptation to arbitrary image re

5、solution. History Edition Recommendation Approval Study Group 1.0 ITU-T J.603 2011-04-29 9 ii Rec. ITU-T J.603 (04/2011) FOREWORD The International Telecommunication Union (ITU) is the United Nations specialized agency in the field of telecommunications, information and communication technologies (I

6、CTs). The ITU Telecommunication Standardization Sector (ITU-T) is a permanent organ of ITU. ITU-T is responsible for studying technical, operating and tariff questions and issuing Recommendations on them with a view to standardizing telecommunications on a worldwide basis. The World Telecommunicatio

7、n Standardization Assembly (WTSA), which meets every four years, establishes the topics for study by the ITU-T study groups which, in turn, produce Recommendations on these topics. The approval of ITU-T Recommendations is covered by the procedure laid down in WTSA Resolution 1. In some areas of info

8、rmation technology which fall within ITU-Ts purview, the necessary standards are prepared on a collaborative basis with ISO and IEC. NOTE In this Recommendation, the expression “Administration“ is used for conciseness to indicate both a telecommunication administration and a recognized operating age

9、ncy. Compliance with this Recommendation is voluntary. However, the Recommendation may contain certain mandatory provisions (to ensure, e.g., interoperability or applicability) and compliance with the Recommendation is achieved when all of these mandatory provisions are met. The words “shall“ or som

10、e other obligatory language such as “must“ and the negative equivalents are used to express requirements. The use of such words does not suggest that compliance with the Recommendation is required of any party. INTELLECTUAL PROPERTY RIGHTS ITU draws attention to the possibility that the practice or

11、implementation of this Recommendation may involve the use of a claimed Intellectual Property Right. ITU takes no position concerning the evidence, validity or applicability of claimed Intellectual Property Rights, whether asserted by ITU members or others outside of the Recommendation development pr

12、ocess. As of the date of approval of this Recommendation, ITU had not received notice of intellectual property, protected by patents, which may be required to implement this Recommendation. However, implementers are cautioned that this may not represent the latest information and are therefore stron

13、gly urged to consult the TSB patent database at http:/www.itu.int/ITU-T/ipr/. ITU 2011 All rights reserved. No part of this publication may be reproduced, by any means whatsoever, without the prior written permission of ITU. Rec. ITU-T J.603 (04/2011) iii Table of Contents Page 1 Scope 1 2 Reference

14、s. 1 3 Definitions 1 4 Abbreviations and acronyms 1 5 Conventions 2 6 Function components of real-time transmission system . 2 6.1 Formulation of function components . 2 Appendix I Conformance to requirements specified in ITU-T J.602 . 5 I.1 Multi-format support 5 I.2 Notification of spatial depende

15、ncy . 5 I.3 Notification of resolution-layer dependency 5 I.4 Single bitstream support . 5 I.5 Bitstream conformance (multi-codec support) . 5 Appendix II Example of encoder system under parallel processing functionality . 6 II.1 Parallel processing 6 II.2 Detailed function of encoder unit . 6 Rec.

16、ITU-T J.603 (04/2011) 1 Recommendation ITU-T J.603 Real-time transmission system for signals of an expanded hierarchy of large screen digital imagery using spatial image segmentation for parallel processing 1 Scope The general guideline for transmitting large screen digital imagery (LSDI) programmes

17、 has been specified in ITU-T J.601, and the network service operators requirements for real-time transmission of expanded hierarchy of large screen digital imagery (exLSDI) signals under parallel processing functionality have been specified in ITU-T J.602. This Recommendation specifies the function

18、components of a real-time transmission system for exLSDI signals compliant with ITU-T J.601 and ITU-T J.602 using spatial image segmentation for parallel processing. This system comprises of multiple video codec function units of any coding standards. The system also enables flexible adaptation to a

19、ny image resolution available as an expanded hierarchy of LSDI. 2 References The following ITU-T Recommendations and other references contain provisions which, through reference in this text, constitute provisions of this Recommendation. At the time of publication, the editions indicated were valid.

20、 All Recommendations and other references are subject to revision; users of this Recommendation are therefore encouraged to investigate the possibility of applying the most recent edition of the Recommendations and other references listed below. A list of the currently valid ITU-T Recommendations is

21、 regularly published. The reference to a document within this Recommendation does not give it, as a stand-alone document, the status of a Recommendation. ITU-T H.222.0 Recommendation ITU-T H.222.0 (2006) | ISO/IEC 13818-1:2007, Information technology Generic coding of moving pictures and associated

22、audio information: Systems. ITU-T J.601 Recommendation ITU-T J.601 (2005), Transport of Large Screen Digital Imagery (LSDI) applications for its expanded hierarchy. ITU-T J.602 Recommendation ITU-T J.602 (2008), Network service operators requirements for real-time transmission of exLSDI signals unde

23、r parallel processing functionality. ITU-R BT.1769 Recommendation ITU-R BT.1769 (2006), Parameter values for an expanded hierarchy of LSDI image formats for production and international programme exchange. 3 Definitions This Recommendation defines no additional terms. 4 Abbreviations and acronyms Th

24、is Recommendation uses the following abbreviations and acronyms: CPU Central Processing Unit DCT Discrete Cosine Transform DSP Digital Signal Processor exLSDI expanded hierarchy of Large Screen Digital Imagery 2 Rec. ITU-T J.603 (04/2011) FPGA Field Programmable Gate Array LSDI Large Screen Digital

25、Imagery MC Motion Compensation ME Motion Estimation PES Packetized Elementary Stream VLC Variable Length Coding 5 Conventions None. 6 Function components of real-time transmission system 6.1 Formulation of function components The basic function components are summarized in Figure 1. The formulation

26、of every function component included in the figure is described in the following. J.603(11)_F01Encoder systemInput exLSDI signalVideo INEncodermanagementMultiplex/transportOutput transport streamEncoder unitDecoder systemOutput exLSDI signalInput transport streamTransport/demultiplexDecodermanagemen

27、tVideo OUTDecoder unitFigure 1 Function components of exLSDI real-time transmission system 6.1.1 Encoder system The encoder system manages all encoder units to accomplish real-time encoding at full-resolution level. The encoder unit performs the video encoder process for a partitioned video frame. I

28、n the encoder system, the encoder unit is connected to three processing modules: the video input, encoder management, and multiplex and transport. Specific functions required for every module are described below. 6.1.1.1 Video input The video input module firstly receives a full-resolution video fra

29、me from the external device and then divides it into smaller image units, which are simply called partitioned video frames in this Recommendation. Every partitioned video has the same frame rate. In case that an overlapped image area is placed among partitioned video frames constituting an exLSDI fu

30、ll resolution frame, Rec. ITU-T J.603 (04/2011) 3 information to identify the overlapped area shall be transmitted. These partitioned video frames are accessible from the corresponding encoder unit. This procedure is conducted frame-by-frame successively. (Input) Full-resolution video frame. (Output

31、) Partitioned video frames. 6.1.1.2 Encoder management This module manages all encoder units. The encoder control functions that should be conducted at a full-resolution level are centralized on this module. For every encoder unit1, the partitioned video frames are distributed. For this module, actu

32、al input and output signals are dependent on an employed encoder unit. As in the example, the input and output are described below: (Input) Statistical information of the encoding result. Monitoring information of the processing performance. (Output) Rate control information. Prediction control info

33、rmation to enable the motion-compensated prediction across the partition boundary. This information is useful to enable the single video elementary stream at exLSDI resolution. 6.1.1.3 Multiplex and transport As a result of the encoding process, a partial bitstream can be extracted from every encode

34、r unit. For those extracted bitstreams, the multiplex and transport module generates a full-resolution bitstream after an appropriate multiplexing process. (Input) Partial bitstream from every encoder unit. (Output) Single bitstream compliant with ITU-T H.222.0 transport stream which is generated by

35、 multiplexing partial bitstreams. Transport mechanism: For a multiplexed bitstream, a transport mechanism based on ITU-T J.601 is applied. Media synchronization: In the case of input material with synchronized audio signals, media synchronization is established by the packetized elementary stream (P

36、ES) synchronization mechanism specified in ITU-T H.222.0. Spatial dependency identification: For the bitstream corresponding to a specific partitioned video frame, the spatial dependency is identified along the descriptor mechanism specified in ITU-T H.222.0. The overall resolution of the exLSDI sig

37、nal is described by the target_background_grid_descriptor. For every partial bitstream, the spatial dependency within the exLSDI image area is described by the video_window_descriptor. 6.1.2 Decoder system The decoder system manages all decoder units to accomplish real-time decoding at full-resoluti

38、on level. The decoder unit performs the video decoder process for a partitioned video frame. In the decoder system, the decoder unit is connected to three processing modules: the video output, decoder management, and transport and demultiplex. The specific functions required for every module are des

39、cribed below. _ 1An implementation example can be found in Appendix II. 4 Rec. ITU-T J.603 (04/2011) 6.1.2.1 Video output The video output module receives partitioned video frames from the corresponding decoder unit, and output a full-resolution video frame via the external interface. This procedure

40、 is conducted frame-by-frame successively. (Input) Partitioned video frames. (Output) Full-resolution video frame. 6.1.2.2 Decoder management This module manages all decoder units. The decoder control functions that should be conducted at a full-resolution level are centralized in this module. From

41、every decoder unit, the partitioned video frames are extracted and fed into the video output module. For this module, the actual input and output signals are dependent on an employed decoder unit. As in the example, the input and output are described below: (Input) Monitoring information of processi

42、ng performance. (Output) Prediction control information to enable the motion-compensated prediction across the partition boundary. This information is useful to enable the single video elementary stream at exLSDI resolution. 6.1.2.3 Transport and demultiplex The transport and demultiplex module rece

43、ives a single bitstream from the content delivery network. A partial bitstream is extracted from the full resolution bitstream and fed into every decoder unit. For the bitstream corresponding to a specific partitioned video frame, the appropriate decoder unit is identified under the mechanism of spa

44、tial dependency identification, as described in clause 6.1.1.3. (Input) Single bitstream compliant with ITU-T H.222.0 transport stream which is generated by multiplexing partial bitstreams. (Output) Partial bitstream for every decoder unit. Transport mechanism: For a multiplexed bitstream, a transpo

45、rt mechanism based on ITU-T J.601 is applied. Media synchronization: In the case of input material with synchronized audio signals, media synchronization is established by the PES synchronization mechanism specified in ITU-T H.222.0. Rec. ITU-T J.603 (04/2011) 5 Appendix I Conformance to requirement

46、s specified in ITU-T J.602 (This appendix does not form an integral part of this Recommendation.) This appendix describes the conformance of the recommended system to ITU-T J.602. I.1 Multi-format support The recommended system can be configured flexibly by selecting the number of the constituting p

47、rocessors to handle various image resolutions, e.g., from HDTV to exLSDI. I.2 Notification of spatial dependency In the recommended system, the transmission process is capable of notifying a spatial dependency in a full resolution picture, if parallel processing is adopted for spatially partitioned

48、images. I.3 Notification of resolution-layer dependency In the recommended system, the transmission process is capable of notifying a resolution-layer dependency in the overall bitstream by utilizing the standard transport stream descriptor under the resolution scalability coding functionality. I.4

49、Single bitstream support The recommended system comprising multiple codec units generates and accepts the single transport stream. I.5 Bitstream conformance (multi-codec support) The recommended system itself does not restrict the coding scheme. Since a codec unit process is implemented on a corresponding programmable module, shifting to another new coding scheme can be realized just by reloading the proper software module. 6 Rec. ITU-T J.603 (04/2011) Appendix II Example of encoder system under parallel processing functi