ITU-T H 222 0 AMD 6-2016 Information technology – Generic coding of moving pictures and associated audio information Systems Amendment 6 Carriage of quality metadata in MPEG-2 syst.pdf

1、 I n t e r n a t i o n a l T e l e c o m m u n i c a t i o n U n i o n ITU-T H.222.0 TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU Amendment 6 (07/2016) SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS Infrastructure of audiovisual services Transmission multiplexing and synchronization Information tec

2、hnology Generic coding of moving pictures and associated audio information: Systems Amendment 6: Carriage of quality metadata in MPEG-2 systems Recommendation ITU-T H.222.0 (2014) Amendment 6 ITU-T H-SERIES RECOMMENDATIONS AUDIOVISUAL AND MULTIMEDIA SYSTEMS CHARACTERISTICS OF VISUAL TELEPHONE SYSTEM

3、S H.100H.199 INFRASTRUCTURE OF AUDIOVISUAL SERVICES General H.200H.219 Transmission multiplexing and synchronization H.220H.229 Systems aspects H.230H.239 Communication procedures H.240H.259 Coding of moving video H.260H.279 Related systems aspects H.280H.299 Systems and terminal equipment for audio

4、visual services H.300H.349 Directory services architecture for audiovisual and multimedia services H.350H.359 Quality of service architecture for audiovisual and multimedia services H.360H.369 Telepresence H.420H.429 Supplementary services for multimedia H.450H.499 MOBILITY AND COLLABORATION PROCEDU

5、RES Overview of Mobility and Collaboration, definitions, protocols and procedures H.500H.509 Mobility for H-Series multimedia systems and services H.510H.519 Mobile multimedia collaboration applications and services H.520H.529 Security for mobile multimedia systems and services H.530H.539 Security f

6、or mobile multimedia collaboration applications and services H.540H.549 Mobility interworking procedures H.550H.559 Mobile multimedia collaboration inter-working procedures H.560H.569 BROADBAND, TRIPLE-PLAY AND ADVANCED MULTIMEDIA SERVICES Broadband multimedia services over VDSL H.610H.619 Advanced

7、multimedia services and applications H.620H.629 Ubiquitous sensor network applications and Internet of Things H.640H.649 IPTV MULTIMEDIA SERVICES AND APPLICATIONS FOR IPTV General aspects H.700H.719 IPTV terminal devices H.720H.729 IPTV middleware H.730H.739 IPTV application event handling H.740H.74

8、9 IPTV metadata H.750H.759 IPTV multimedia application frameworks H.760H.769 IPTV service discovery up to consumption H.770H.779 Digital Signage H.780H.789 E-HEALTH MULTIMEDIA SERVICES AND APPLICATIONS Personal health systems H.810H.819 Interoperability compliance testing of personal health systems

9、(HRN, PAN, LAN, TAN and WAN) H.820H.859 Multimedia e-health data exchange services H.860H.869 For further details, please refer to the list of ITU-T Recommendations. Rec. ITU-T H.222.0 (2014)/Amd.6 (07/2016) i INTERNATIONAL STANDARD ISO/IEC 13818-1 RECOMMENDATION ITU-T H.222.0 Information technology

10、 Generic coding of moving pictures and associated audio information: Systems Amendment 6 Carriage of quality metadata in MPEG-2 systems Summary Amendment 6 specifies the carriage of quality metadata (ISO/IEC 23001-10) in ITU-T H.222.0 (2014) | ISO/IEC 13818-1:2015. Quality metadata enhances adaptive

11、 streaming in clients during the presentation of media. The carriage is specified for transport streams only and includes the signalling of static metadata as well as dynamic metadata. History Edition Recommendation Approval Study Group Unique ID* 1.0 ITU-T H.222.0 1995-07-10 15 11.1002/1000/1071 1.

12、1 ITU-T H.222.0 (1995) Amd. 1 1996-11-11 16 11.1002/1000/3834 1.2 ITU-T H.222.0 (1995) Amd. 2 1996-11-11 16 11.1002/1000/4096 1.3 ITU-T H.222.0 (1995) Technical Cor. 1 1998-02-06 16 11.1002/1000/4532 1.4 ITU-T H.222.0 (1995) Amd. 3 1998-02-06 16 11.1002/1000/4228 1.5 ITU-T H.222.0 (1995) Amd. 4 1998

13、-02-06 16 11.1002/1000/4229 1.6 ITU-T H.222.0 (1995) Amd. 5 1999-05-27 16 11.1002/1000/4498 1.7 ITU-T H.222.0 (1995) Amd. 6 1999-05-27 16 11.1002/1000/4671 2.0 ITU-T H.222.0 2000-02-17 16 11.1002/1000/5142 2.1 ITU-T H.222.0 (2000) Technical Cor. 1 2001-03-01 16 11.1002/1000/5419 2.2 ITU-T H.222.0 (2

14、000) Technical Cor. 2 2002-03-29 16 11.1002/1000/5675 2.3 ITU-T H.222.0 (2000) Amd. 1 2002-12-14 16 11.1002/1000/6190 2.4 ITU-T H.222.0 (2000) Amd. 1/Cor. 1 2003-06-29 16 11.1002/1000/6449 2.5 ITU-T H.222.0 (2000) Amd. 2 2003-06-29 16 11.1002/1000/6363 2.6 ITU-T H.222.0 (2000) Amd. 3 2004-03-15 16 1

15、1.1002/1000/7208 2.7 ITU-T H.222.0 (2000) Technical Cor. 3 2005-01-08 16 11.1002/1000/7435 2.8 ITU-T H.222.0 (2000) Amd. 4 2005-01-08 16 11.1002/1000/7436 2.9 ITU-T H.222.0 (2000) Amd. 5 2005-01-08 16 11.1002/1000/7437 2.10 ITU-T H.222.0 (2000) Technical Cor. 4 2005-09-13 16 11.1002/1000/8560 3.0 IT

16、U-T H.222.0 2006-05-29 16 11.1002/1000/8802 3.1 ITU-T H.222.0 (2006) Amd. 1 2007-01-13 16 11.1002/1000/9024 3.2 ITU-T H.222.0 (2006) Amd. 2 2007-08-29 16 11.1002/1000/9214 3.3 ITU-T H.222.0 (2006) Cor. 1 2008-06-13 16 11.1002/1000/9471 3.4 ITU-T H.222.0 (2006) Cor. 2 2009-03-16 16 11.1002/1000/9692

17、3.5 ITU-T H.222.0 (2006) Amd. 3 2009-03-16 16 11.1002/1000/9691 3.6 ITU-T H.222.0 (2006) Cor. 3 2009-12-14 16 11.1002/1000/10621 * To access the Recommendation, type the URL http:/handle.itu.int/ in the address field of your web browser, followed by the Recommendations unique ID. For example, http:/

18、handle.itu.int/11.1002/1000/11830-en. ii Rec. ITU-T H.222.0 (2014)/Amd.6 (07/2016) 3.7 ITU-T H.222.0 (2006) Cor. 4 2009-12-14 16 11.1002/1000/10622 3.8 ITU-T H.222.0 (2006) Amd. 4 2009-12-14 16 11.1002/1000/10623 3.9 ITU-T H.222.0 (2006) Amd. 5 2011-05-14 16 11.1002/1000/11287 3.10 ITU-T H.222.0 (20

19、06) Amd. 6 2011-05-14 16 11.1002/1000/11288 4.0 ITU-T H.222.0 2012-06-29 16 11.1002/1000/11655 4.1 ITU-T H.222.0 (2012) Amd. 1 2014-01-13 16 11.1002/1000/12054 4.2 ITU-T H.222.0 (2012) Amd. 2 2014-01-13 16 11.1002/1000/12055 4.3 ITU-T H.222.0 (2012) Amd. 3 2014-01-13 16 11.1002/1000/12056 4.4 ITU-T

20、H.222.0 (2012) Amd. 4 2014-01-13 16 11.1002/1000/12057 4.5 ITU-T H.222.0 (2012) Amd. 5 2014-10-14 16 11.1002/1000/12306 5.0 ITU-T H.222.0 2014-10-14 16 11.1002/1000/12359 5.1 ITU-T H.222.0 (2014) Amd. 1 2015-04-29 16 11.1002/1000/12452 5.2 ITU-T H.222.0 (2014) Amd. 1 Cor. 1 2015-11-29 16 11.1002/100

21、0/12625 5.3 ITU-T H.222.0 (2014) Amd. 2 2015-12-14 16 11.1002/1000/12632 5.4 ITU-T H.222.0 (2014) Amd. 3 2015-12-14 16 11.1002/1000/12633 5.5 ITU-T H.222.0 (2014) Amd. 1 Cor. 2 2016-07-14 16 11.1002/1000/12899 5.6 ITU-T H.222.0 (2014) Cor. 1 2016-07-14 16 11.1002/1000/12903 5.7 ITU-T H.222.0 (2014)

22、Amd. 4 2016-07-14 16 11.1002/1000/12900 5.8 ITU-T H.222.0 (2014) Amd. 5 2016-07-14 16 11.1002/1000/12901 5.9 ITU-T H.222.0 (2014) Amd. 6 2016-07-14 16 11.1002/1000/12902 Rec. ITU-T H.222.0 (2014)/Amd.6 (07/2016) iii FOREWORD The International Telecommunication Union (ITU) is the United Nations speci

23、alized agency in the field of telecommunications, information and communication technologies (ICTs). The ITU Telecommunication Standardization Sector (ITU-T) is a permanent organ of ITU. ITU-T is responsible for studying technical, operating and tariff questions and issuing Recommendations on them w

24、ith a view to standardizing telecommunications on a worldwide basis. The World Telecommunication Standardization Assembly (WTSA), which meets every four years, establishes the topics for study by the ITU-T study groups which, in turn, produce Recommendations on these topics. The approval of ITU-T Re

25、commendations is covered by the procedure laid down in WTSA Resolution 1. In some areas of information technology which fall within ITU-Ts purview, the necessary standards are prepared on a collaborative basis with ISO and IEC. NOTE In this Recommendation, the expression “Administration“ is used for

26、 conciseness to indicate both a telecommunication administration and a recognized operating agency. Compliance with this Recommendation is voluntary. However, the Recommendation may contain certain mandatory provisions (to ensure, e.g., interoperability or applicability) and compliance with the Reco

27、mmendation is achieved when all of these mandatory provisions are met. The words “shall“ or some other obligatory language such as “must“ and the negative equivalents are used to express requirements. The use of such words does not suggest that compliance with the Recommendation is required of any p

28、arty. INTELLECTUAL PROPERTY RIGHTSITU draws attention to the possibility that the practice or implementation of this Recommendation may involve the use of a claimed Intellectual Property Right. ITU takes no position concerning the evidence, validity or applicability of claimed Intellectual Property

29、Rights, whether asserted by ITU members or others outside of the Recommendation development process. As of the date of approval of this Recommendation, ITU had received notice of intellectual property, protected by patents, which may be required to implement this Recommendation. However, implementer

30、s are cautioned that this may not represent the latest information and are therefore strongly urged to consult the TSB patent database at http:/www.itu.int/ITU-T/ipr/. ITU 2016 All rights reserved. No part of this publication may be reproduced, by any means whatsoever, without the prior written perm

31、ission of ITU. ISO/IEC 13818-1:2015/Amd.6:2016 (E) Rec. ITU-T H.222.0 (2014)/Amd.6 (07/2016) 1 INTERNATIONAL STANDARD ITU-T RECOMMENDATION Information technology Generic coding of moving pictures and associated audio information: Systems Amendment 6 Carriage of quality metadata in MPEG-2 systems 1)

32、Clause 1.2.3 In clause 1.2.3 add: ISO/IEC 23001-10:2015, Information technology MPEG systems technologies Part 10: Carriage of timed metadata metrics of media in ISO base media file format. 2) Clause 2.1 In clause 2.1 add the following after clause 2.1.128: 2.1.129 quality access unit: An access uni

33、t that contains dynamic quality metadata as defined in ISO/IEC 23001-10. 3) Table 2-31 Replace Table 2-31 by the following: Table 2-31 table_id assignment values Value Description 0x00 program_association_section 0x01 conditional_access_section (CA_section) 0x02 TS_program_map_section 0x03 TS_descri

34、ption_section 0x04 ISO_IEC_14496_scene_description_section 0x05 ISO_IEC_14496_object_descriptor_section 0x06 Metadata_section 0x07 IPMP_Control_Information_section (defined in ISO/IEC 13818-11) 0x08 ISO_IEC_14496_section 0x09 ISO/IEC 23001-11 (Green Access Unit) section 0x0A ISO/IEC 23001-10 (Qualit

35、y Access Unit) section 0x0B-0x37 Rec. ITU-T H.222.0 | ISO/IEC 13818-1 reserved 0x38-0x3F Defined in ISO/IEC 13818-6 0x40-0xFE User private 0xFF Forbidden 4) Table 2-34 In Table 2-34 add the following: 0x2F Quality Access Units carried in sections 0x30-0x7E Rec. ITU-T H.222.0 | ISO/IEC 13818-1 reserv

36、ed ISO/IEC 13818-1:2015/Amd.6:2016 (E) 2 Rec. ITU-T H.222.0 (2014)/Amd.6 (07/2016) 5) Clause 2.6.90 Replace Table 2-105 with: Table 2-105 Extension descriptor Syntax No. of bits Mnemonic Extension_descriptor () descriptor_tag 8 uimsbf descriptor_length 8 uimsbf extension_descriptor_tag 8 uimsbf if (

37、 extension_descriptor_tag = 0x02) ObjectDescriptorUpdate() else if ( extension_descriptor_tag = 0x03) HEVC_timing_and_HRD_descriptor() else if ( extension_descriptor_tag = 0x04) af_extension_descriptor() else if ( extension_descriptor_tag = 0x05) HEVC_operation_point_descriptor() else if ( extension

38、_descriptor_tag = 0x06) HEVC_hierachy_extension_descriptor() else if ( extension_descriptor_tag = 0x07) Green_extension_descriptor () else if ( extension_descriptor_tag = 0x08) MPEG-H_3dAudio_descriptor() else if ( extension_descriptor_tag = 0x09) MPEG-H_3dAudio_config_descriptor() else if ( extensi

39、on_descriptor_tag = 0x0A) MPEG-H_3dAudio_scene_descriptor() else if ( extension_descriptor_tag = 0x0B) MPEG-H_3dAudio_text_label_descriptor() else if ( extension_descriptor_tag = 0x0C) MPEG-H_3dAudio_multi-stream_descriptor() else if ( extension_descriptor_tag = 0x0D) MPEG-H_3dAudio_drc_loudness_des

40、criptor() else if ( extension_descriptor_tag = 0x0E) MPEG-H_3dAudio_command_descriptor() else if ( extension_descriptor_tag = 0x0F) Quality_extension_descriptor () else ISO/IEC 13818-1:2015/Amd.6:2016 (E) Rec. ITU-T H.222.0 (2014)/Amd.6 (07/2016) 3 Table 2-105 Extension descriptor Syntax No. of bits

41、 Mnemonic for ( i=0; iN; i+ ) reserved 8 bslbf 6) Clause 2.6.91 Add the following immediately before Table 2-106: Quality_extension_descriptor() This structure is defined in 2.6.119. Replace Table 2-106 with: Table 2-106 Extension descriptor tag values Extension_descriptor_tag TS PS Identification 0

42、 n/a n/a Reserved 1 n/a X Forbidden 2 X X ODUpdate_descriptor 3 X n/a HEVC_timing_and_HRD_descriptor() 4 X n/a af_extensions_descriptor() 5 X n/a HEVC_operation_point_descriptor() 6 X n/a hierarchy_extension_descriptor() 7 X n/a Green_extension_descriptor() 8 X n/a MPEG-H_3dAudio_descriptor() 9 X n/

43、a MPEG-H_3dAudio_config_descriptor() 0x0A X n/a MPEG-H_3dAudio_scene_descriptor() 0x0B X n/a MPEG-H_3dAudio_text_label_descriptor() 0x0C X n/a MPEG-H_3dAudio_multi-stream_descriptor() 0x0D X n/a MPEG-H_3dAudio_drc_loudness_descriptor() 0x0E X n/a MPEG-H_3dAudio_command_descriptor() 0x0F X n/a Qualit

44、y_extension_descriptor() 0x10-0xFF n/a n/a Rec. ITU-T H.222.0 | ISO/IEC 13818-1 Reserved 7) Clause 2.6.119 Add the following clause after clause 2.6.118: 2.6.119 Quality extension descriptor The Quality extension descriptor shall be sent once per event or program and hence is signalled using a descr

45、iptor in the Program Map Table. This descriptor shall appear in the elementary stream loop of the PID for which quality information is provided. Dynamic quality metadata is stored in access units and is associated with one or more video frames. These access units are encapsulated in MPEG sections id

46、entified by stream_type value of 0x2F. The Quality extension descriptor describes metrics that are present in each Quality Access Unit, and the constant field size that is used for the values. The quality metrics are defined in clause 4.3 of ISO/IEC 23001-10. The syntax of Quality extension descript

47、or containing static metadata is shown in Table 111terdecies. ISO/IEC 13818-1:2015/Amd.6:2016 (E) 4 Rec. ITU-T H.222.0 (2014)/Amd.6 (07/2016) Table 2-111terdecies Quality extension descriptor Syntax No. bits Mnemonic Quality_extension_descriptor() field_size_bytes 8 uimsbf metric_count 8 uimsbf for

48、(i=0; i metric_count; i+) metric_codei 32 uimsbf field_size_bytes indicates the constant size in bytes of the value for a metric in each Quality Access Unit metric_count: The number of metrics for quality values in each Quality Access Unit metric_code is the code name of the metrics in the Quality A

49、ccess Unit Semantics for all the syntax elements above are specified in clause 4.2 of ISO/IEC 23001-10. The quality metrics to be signalled can also be found in clause 4.3 of ISO/IEC 23001-10 and include: PSNR = Peak Signal to Noise Ratio SSIM = Structural Similarity Index MS-SSIM = Multi-Scale Structural Similarity Index VQM = Video Quality Metric PEVQ = Perceptual Evaluation