ANSI INCITS ISO IEC 14496-1-2001 Information technology Coding of audio-visual objects Part 1 Systems (Adopted by INCITS).pdf

1、Reference numberISO/IEC 14496-1:2001(E)ISO/IEC 2001INTERNATIONALSTANDARDISO/IEC14496-1Second edition2001-10-01Information technology Coding ofaudio-visual objects Part 1:SystemsTechnologies de linformation Codage des objets audiovisuels Partie 1: SystmesAdopted by INCITS (InterNational Committee for

2、 Information Technology Standards) as an American National Standard.Date of ANSI Approval: 11/6/2002Published by American National Standards Institute,25 West 43rd Street, New York, New York 10036Copyright 2002 by Information Technology Industry Council (ITI).All rights reserved.These materials are

3、subject to copyright claims of International Standardization Organization (ISO), InternationalElectrotechnical Commission (IEC), American National Standards Institute (ANSI), and Information Technology Industry Council(ITI). Not for resale. No part of this publication may be reproduced in any form,

4、including an electronic retrieval system, withoutthe prior written permission of ITI. All requests pertaining to this standard should be submitted to ITI, 1250 Eye Street NW,Washington, DC 20005.Printed in the United States of AmericaISO/IEC 14496-1:2001(E)PDF disclaimerThis PDF file may contain emb

5、edded typefaces. In accordance with Adobes licensing policy, this file may be printed or viewed but shall notbe edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading thisfile, parties accept therein the responsibility of n

6、ot infringing Adobes licensing policy. The ISO Central Secretariat accepts no liability in thisarea.Adobe is a trademark of Adobe Systems Incorporated.Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation parameterswere

7、optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In the unlikely eventthat a problem relating to it is found, please inform the Central Secretariat at the address given below. ISO/IEC 2001All rights reserved. Unless otherwise specifi

8、ed, no part of this publication may be reproduced or utilized in any form or by any means, electronicor mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISOs member bodyin the country of the requester.ISO copyright officeCase pos

9、tale 56 Gb7 CH-1211 Geneva 20Tel. + 41 22 749 01 11Fax + 41 22 749 09 47E-mail copyrightiso.chWeb www.iso.chPrinted in Switzerlandii ISO/IEC 2001 All rights reservedISO/IEC 14496-1:2001(E) ISO/IEC 2001 All rights reserved iiiContents Page0 Introduction viii0.1 Overview .viii0.2 Architecture viii0.3

10、Terminal Model: Systems Decoder Modelx0.4 Multiplexing of Streams: The Delivery Layer .x0.5 Synchronization of Streams: The Sync Layerx0.6 The Compression Layer xi0.7 Application Enginexii1 Scope12 Normative references .13 Additional reference .24 Terms and definitions.25 Abbreviations and Symbols.7

11、6 Conventions 87 Systems Decoder Model.87.1 Introduction .87.2 Concepts of the systems decoder model.97.3 Timing Model Specification107.4 Buffer Model Specification.128 Object Description Framework148.1 Introduction .148.2 Common data structures158.3 Intellectual Property Management and Protection (

12、IPMP)178.4 Object Content Information (OCI)198.5 Object Descriptor Stream.218.6 Object Descriptor Components.248.7 Rules for Usage of the Object Description Framework 468.8 Usage of the IPMP System interface.559 Scene Description.589.1 Introduction .589.2 Concepts609.3 BIFS Syntax .749.4 Node Semant

13、ics 13310 Synchronization of Elementary Streams22610.1 Introduction .22610.2 Sync Layer .227ISO/IEC 14496-1:2001(E)iv ISO/IEC 2001 All rights reserved10.3 DMIF Application Interface.23611 MPEG-J.23611.1 Introduction .23611.2 Architecture .23711.3 MPEG-J Session23911.4 Delivery of MPEG-J Data 24011.5

14、 MPEG-J API List 24312 Multiplexing of Elementary Streams .24912.1 Introduction .24912.2 FlexMux Tool .24913 File Format .25513.1 Introduction .25513.2 File organization26013.3 Extensibility .28414 Syntactic Description Language .28514.1 Introduction .28514.2 Elementary Data Types.28514.3 Composite

15、Data Types28814.4 Arithmetic and Logical Expressions.29214.5 Non-Parsable Variables 29214.6 Syntactic Flow Control .29214.7 Built-In Operators29414.8 Scoping Rules .29415 Profiles .29415.1 Introduction .29415.2 OD Profile Definitions .29515.3 Scene Graph Profile Definitions 29515.4 Graphics Profile

16、Definitions.29915.5 MPEG-J Profile Definitions.30115.6 MPEG-J Profiles Tools30115.7 MPEG-J Profiles 30115.8 MPEG-J ProfilesLevels302Annex A (informative) Bibliography 303Annex B (informative) Time Base Reconstruction.304B.1 Time Base Reconstruction.304B.2 Temporal aliasing and audio resampling .305B

17、.3 Reconstruction of a Synchronised Audio-visual Scene: A Walkthrough .305Annex C (normative) View Dependent Object Scalability .307C.1 Introduction .307C.2 Bitstream Syntax.307ISO/IEC 14496-1:2001(E) ISO/IEC 2001 All rights reserved vC.3 Bitstream Semantics.308Annex D (informative) Registration pro

18、cedure 310D.1 Procedure for the request of a Registration ID (RID) 310D.2 Responsibilities of the Registration Authority.310D.3 Contact information for the Registration Authority 310D.4 Responsibilities of Parties Requesting a RID 310D.5 Appeal Procedure for Denied Applications311D.6 Registration Ap

19、plication Form 311Annex E (informative) The QoS Management Model for ISO/IEC 14496 Content .313Annex F (informative) Conversion Between Time and Date Conventions 314Annex G (normative) Adaptive Arithmetic Decoder for BIFS-Anim.316Annex H (normative) Node coding tables.318H.1 Node Tables.318H.2 Node

20、Definition Type Tables341H.3 Node Tables for Extended Nodes348H.4 Node Definition Type Tables for extended node types355Annex I (informative) MPEG-4 Audio TTS application with Facial Animation.357Annex J (informative) Graphical representation of object descriptor and sync layer syntax.358J.1 Length

21、encoding of descriptors and commands 358J.2 Object Descriptor Stream and OD commands.358J.3 IPMP stream.359J.4 OCI stream .359J.5 Object descriptor and its components .359J.6 OCI Descriptors.362J.7 Sync layer configuration and syntax 365Annex K (informative) Patent statements .366K.1 Patent Statemen

22、ts for Version 1366K.2 Patent Statements for Version 2367Annex L (informative) Elementary Stream Interface369Annex M (Informative) Definition of bodySceneGraph nodes371M.1 Introduction .371M.2 Detailed Semantics .371M.3 Overview 371M.4 The Nodes371Annex N (Informative) Implementation of MaterialKey

23、node380Annex O (Informative) Example implementation of spatial audio processing (perceptual approach) 382O.1 Example algorithm implementation 382O.2 Elementary spectral corrector .383O.3 Input Filter384O.4 Direct path .384ISO/IEC 14496-1:2001(E)vi ISO/IEC 2001 All rights reservedO.5 Directional earl

24、y reflections .385O.6 Diffuse late reverberation.385O.7 Setting the delays386O.8 Scalability.387Annex P (informative) Upstream walkthrough .388P.1 Introduction .388P.2 Configuration.388P.3 Content access procedure with DAI389P.4 Example389Annex Q (Informative) Layout of Media Data393Annex R (Informa

25、tive) Random Access 394Annex S (Informative) Starting the Java Virtual Machine .395Annex T (Informative) Examples of MPEG-J API usage396T.1 Scene APIs :.396T.2 Resource and Decoder APIs 400T.3 Net APIs402T.4 Section Filtering APIs .403Annex U (Normative) MPEG-J APIs Listing (HTML) 405Annex V (Normat

26、ive) MPEG-J APIs Listing406V.1 package org.iso.mpeg.mpegj.406V.2 package org.iso.mpeg.mpegj.resource 413V.3 package org.iso.mpeg.mpegj.decoder442V.4 package 454V.5 package org.iso.mpeg.mpegj.scene .461ISO/IEC 14496-1:2001(E) ISO/IEC 2001 All rights reserved viiForewordISO (the International Organiz

27、ation for Standardization) and IEC (the International Electrotechnical Commission)form the specialized system for worldwide standardization. National bodies that are members of ISO or IECparticipate in the development of International Standards through technical committees established by therespecti

28、ve organization to deal with particular fields of technical activity. ISO and IEC technical committeescollaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, inliaison with ISO and IEC, also take part in the work.International Standards are dra

29、fted in accordance with the rules given in the ISO/IEC Directives, Part 3.In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1.Draft International Standards adopted by the joint technical committee are circulated to national bodies for votin

30、g.Publication as an International Standard requires approval by at least 75 % of the national bodies casting a vote.Attention is drawn to the possibility that some of the elements of this part of ISO/IEC 14496 may be the subject ofpatent rights. ISO and IEC shall not be held responsible for identify

31、ing any or all such patent rights.International Standard ISO/IEC 14496-1 was prepared by Joint Technical Committee ISO/IEC JTC 1, Informationtechnology, Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.This second edition cancels and replaces the first edition (ISO

32、/IEC 14496-1:1999), which has been technicallyrevised.ISO/IEC 14496 consists of the following parts, under the general title Information technology Coding of audio-visual objects: Part 1: Systems Part 2: Visual Part 3: Audio Part 4: Conformance testing Part 5: Reference software Part 6: Delivery Mul

33、timedia Integration Framework (DMIF) Part 7: Optimized software for MPEG-4 visual toolsAnnexes C, G, H, U and V form a normative part of this part of ISO/IEC 14496. Annexes A, B, D, E, F and I to T arefor information only.ISO/IEC 14496-1:2001(E)viii ISO/IEC 2001 All rights reserved0 Introduction0.1

34、OverviewISO/IEC 14496 specifies a system for the communication of interactive audio-visual scenes. This specificationincludes the following elements:1. the coded representation of natural or synthetic, two-dimensional (2D) or three-dimensional (3D) objects thatcan be manifested audibly and/or visual

35、ly (audio-visual objects) (specified in part 1,2 and 3 of ISO/IEC 14496);2. the coded representation of the spatio-temporal positioning of audio-visual objects as well as their behavior inresponse to interaction (scene description, specified in this part of ISO/IEC 14496);3. the coded representation

36、 of information related to the management of data streams (synchronization,identification, description and association of stream content, specified in this part of ISO/IEC 14496); and4. a generic interface to the data stream delivery layer functionality (specified in part 6 of ISO/IEC 14496).5. an a

37、pplication engine for programmatic control of the player: format, delivery of downloadable Java byte code aswell as its execution lifecycle and behavior through APIs (specified in this part of ISO/IEC 14496); and6. a file format to contain the media information of an ISO/IEC 14496 presentation in a

38、flexible, extensible format tofacilitate interchange, management, editing, and presentation of the media.The overal operation of a system communicating audio-visual scenes can be paraphrased as follows:At the sending terminal, the audio-visual scene information is compressed, supplemented with synch

39、ronizationinformation and passed to a delivery layer that multiplexes it into one or more coded binary streams that aretransmitted or stored. At the receiving terminal, these streams are demultiplexed and decompressed. The audio-visual objects are composed according to the scene description and sync

40、hronization information and presented tothe end user. The end user may have the option to interact with this presentation. Interaction information can beprocessed locally or transmitted back to the sending terminal. ISO/IEC 14496 defines the syntax and semantics ofthe bitstreams that convey such sce

41、ne information, as well as the details of their decoding processes.This part of ISO/IEC 14496 specifies the following tools:Gb7 a terminal model for time and buffer management;Gb7 a coded representation of interactive audio-visual scene description information (Binary Format for Scenes BIFS);Gb7 a c

42、oded representation of metadata for the identification, description and logical dependencies of theelementary streams (object descriptors and other descriptors);Gb7 a coded representation of descriptive audio-visual content information (object content information OCI);Gb7 an interface to intellectua

43、l property management and protection (IPMP) systems;Gb7 a coded representation of synchronization information (sync layer SL); andGb7 a multiplexed representation of individual elementary streams in a single stream (FlexMux).Gb7 an application engine (MPEG-Java - MPEG-J).These various elements are d

44、escribed functionally in this subclause and specified in the normative clauses thatfollow.0.2 ArchitectureThe information representation specified in ISO/IEC 14496-1 describes the means to create an interactive audio-visual scene in terms of coded audio-visual information and associated scene descri

45、ption information. The entityISO/IEC 14496-1:2001(E) ISO/IEC 2001 All rights reserved ixthat composes and sends, or receives and presents such a coded representation of an interactive audio-visualscene is generically referred to as an “audio-visual terminal“ or just “terminal“. This terminal may cor

46、respond to astandalone application or be part of an application system.Multiplexed StreamsInteractive AudiovisualSceneElementary StreamsComposition and RenderingDisplay andUserInteractionTransmission/Storage Medium(RTP)UDPIPH223PSTNDABMuxDeliveryLayerFlexMux FlexMuxDMIF Application InterfaceSL SLSL

47、SL.SyncLayerElementary Stream InterfaceAV ObjectdataSceneDescriptionInformationObjectDescriptor.CompressionLayerSLSL-Packetized Streams(PES)MPEG-2TSAAL2ATMUpstreamInformationSLSLFlexMux.Figure 1 - The ISO/IEC 14496 terminal architectureThe basic operations performed by such a receiver terminal are a

48、s follows. Information that allows access tocontent complying with ISO/IEC 14496 is provided as initial session set up information to the terminal. Part 6 ofISO/IEC 14496 defines the procedures for establishing such session contexts as well as the interface to thedelivery layer that generically abst

49、racts the storage or transport medium. The initial set up information allows, in arecursive manner, to locate one or more elementary streams that are part of the coded content representation.Some of these elementary streams may be grouped together using the multiplexing tool described in ISO/IEC14496-1.ISO/IEC 14496-1:2001(E)x ISO/IEC 2001 All rights reservedElementary streams contain the coded representation of either audio or visual data or scene descriptioninformation. Elementary streams may as well themselve