CAN CSA-ISO IEC 15938-3B-2007 Information technology - Multimedia content description interface - Part 3 Visual AMENDMENT 2 Perceptual 3D Shape Descriptor.pdf

1、 Reference numberISO/IEC 15938-3:2002/Amd.2:2006(E)ISO/IEC 2006Information technology Multimedia content description interface Part 3: Visual AMENDMENT 2: Perceptual 3D Shape Descriptor Technologies de linformation Interface de description du contenu multimdia Partie 3: Visuel AMENDEMENT 2: Descript

2、eur sensoriel de forme 3D International Organization for Standardization (ISO), 2006. All rights reserved. International Electrotechnical Commission (IEC), 2006. All rights reserved. NOT FOR RESALE. Amendment 2:2007 toNational Standard of CanadaCAN/CSA-ISO/IEC 15938-3:04Amendment 2:2006 to Internati

3、onal Standard ISO/IEC 15938-3:2002 has been adopted withoutmodification (IDT) as Amendment 2:2007 to CAN/CSA-ISO/IEC 15938-3:04. This Amendment was reviewedby the CSA Technical Committee on Information Technology (TCIT) under the jurisdiction of the StrategicSteering Committee on Information Technol

4、ogy and deemed acceptable for use in Canada.August 2007ISO/IEC 15938-3:2002/Amd.2:2006(E) PDF disclaimer This PDF file may contain embedded typefaces. In accordance with Adobes licensing policy, this file may be printed or viewed but shall not be edited unless the typefaces which are embedded are li

5、censed to and installed on the computer performing the editing. In downloading this file, parties accept therein the responsibility of not infringing Adobes licensing policy. The ISO Central Secretariat accepts no liability in this area. Adobe is a trademark of Adobe Systems Incorporated. Details of

6、 the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In the unlikely event that a problem relatin

7、g to it is found, please inform the Central Secretariat at the address given below. ISO/IEC 2006 All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, wit

8、hout permission in writing from either ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.orgii ISO/IEC 2006 All rights reservedAmendment

9、 2:2007 toCAN/CSA-ISO/IEC 15938-3:04ISO/IEC 15938-3:2002/Amd.2:2006(E) ISO/IEC 2006 All rights reserved iiiForeword ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bod

10、ies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other

11、international organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. International Standards are drafted in accordance with the rules g

12、iven in the ISO/IEC Directives, Part 2. The main task of the joint technical committee is to prepare International Standards. Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as an International Standard requires approva

13、l by at least 75 % of the national bodies casting a vote. Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. Amendment 2 to ISO/IEC 15938-3:2002

14、 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology, Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information. This document preserves the sectioning of ISO/IEC 15938-3. The text and figures given in this Amendment are currently being considere

15、d as additions and/or modifications to those corresponding sections in ISO/IEC 15938-3. Amendment 2:2007 toCAN/CSA-ISO/IEC 15938-3:04ISO/IEC 15938-3:2002/Amd.2:2006(E) ISO/IEC 2006 All rights reserved 1Information technology Multimedia content description interface Part 3: Visual AMENDMENT 2: Percep

16、tual 3D Shape Descriptor Replace subclause 1.2 with: 1.2 Overview of Visual Description Tools This part of ISO/IEC 15938 specifies tools for description of visual content, including still images, video and 3D models. These tools are defined by their syntax in DDL and binary representations and seman

17、tics associated with the syntactic elements. They enable description of the visual features of the visual material, such as color, texture, shape and motion, as well as localization of the described objects in the image or video sequence. An overview of the visual description tools is shown in Figur

18、e 1. The basic structure description tools include five supporting tools of visual descriptions defined in clauses 6-11. They are categorized into two groups, descriptor containers and basic supporting tools. The former consists of three datatypes, GridLayout providing efficient representations of v

19、isual features on grids, TimeSeries representing temporal arrays of several descriptions, GofGopFeature describes representative descriptions over video segment, and MultipleView describing a 3D object using several pictures captured from different view angles. The latter contains two tools, Spatial

20、2DcoordinateSystem used to specify the 2D coordinate system and TemporalInterpolation indicating the interpolation method between two samples on a time axis. The remaining description tools, except for the FaceRecognition descriptor, are associated with visual features and are grouped into five feat

21、ure categories: Color, Texture, Shape, Motion and Localization. The color description tools include five color descriptors to represent different aspects of color features: representative colors (DominantColor), color distribution (ScalableColor), spatial distribution of colors (ColorLayout and Colo

22、rStructure) and perceptual feeling of illumination color (ColorTemperature). It also contains three supporting tools, ColorSpace and ColorQuantization used in DominantColor and IlluminationInvariantColor to extend four color descriptors, DominantColor, ScalableColor, ColorLayout and ColorStructure,

23、to support illumination invariant similarity matching. An extension of ScalableColor to a group of frames or pictures (GoFGoPColor) is also included in this group. All the color descriptors can be extracted from arbitrarily shaped regions. The texture description tools facilitate browsing (TextureBr

24、owsing) and similarity retrieval (HomogeneousTexture and EdgeHistogram) using the texture of a still or moving image region. All the texture descriptors can be extracted from arbitrarily shaped regions. The shape description tools include two descriptors that characterize different shape features of

25、 a 2D object or region. The RegionShape descriptor captures the distribution of all pixels within a region and the Contour Shape descriptor characterizes the shape properties of the contour of an object. The extension of RegionShape is also defined as ShapeVariation to describe temporal variation of

26、 shape over video segment. The Shape3D and Perceptual 3D Shape descriptors provide 3-dimensional shape information; the former represents an intrinsic shape characterization of 3D mesh models, and the latter represents part-based representation of a 3D object. The motion description tools include fo

27、ur descriptors that characterize various aspects of motion. The CameraMotion descriptor specifies a set of basic camera operations such as, for example, panning and tilting. Amendment 2:2007 toCAN/CSA-ISO/IEC 15938-3:04ISO/IEC 15938-3:2002/Amd.2:2006(E) 2 ISO/IEC 2006 All rights reservedThe motion o

28、f a key point (pixel) from a moving object or region can be characterized by the MotionTrajectory descriptor. The ParametricMotion descriptor characterizes an evolution of an arbitrarily shaped region over time in terms of a 2D geometric transformation. Finally, the MotionActivity descriptor capture

29、s the pace of the motion in the sequence, as perceived by the viewer. All motion descriptors except for CameraMotion can be extracted from arbitrarily shaped regions. The localization description tools can be used to indicate regions of interest in the spatial (RegionLocator) and spatio-temporal (Sp

30、atioTemporalLocator) domains. The FaceRecognition descriptor and the Advance Face Recognition descriptor are not associated with any particular visual feature and can be used to describe a human face for applications requiring the matching and retrieval of face images. Figure 1 Overview of Visual De

31、scription Tools Basic Structures Descriptor ContainersGridLayout TimeSeries MultipleView Basic Supporting ToolsTemporalInterpolationSpatial2DcoordinateSystemColor Color Feature Descriptors DominantColor ScalableColor ColorLayout ColorStructure GofGopColor Color Supporting ToolsColorSpaceColorQuantiz

32、ationTexture HomogeneousTextureTextureBrowsing EdgeHistogram MotionCameraMotion MotionTrajectory ParametricMotion MotionActivity Localization RegionLocator SpatioTemporalLocatorRegionShapeContourShapeShape3DShapeVisual Features GofGopFeature ShapeVariationOther FaceRecognition AdvancedFaceRecognitio

33、nColorTemperaturePerceptual 3D Shape IlluminationInvariantColorAmendment 2:2007 toCAN/CSA-ISO/IEC 15938-3:04ISO/IEC 15938-3:2002/Amd.2:2006(E) ISO/IEC 2006 All rights reserved 3Extend the definitions in clause 2: 2.4 adjacency matrix matrix with rows and columns labeled by graph vertices, with a 1 o

34、r 0 in position (i, j) according to whether i-th and j-th nodes are adjacent or not. Replace subclause 4.2.2 with: 4.2.2 Generic binary representation The use of the video-specific syntax is signalled using the codec configuration mechanism defined in ISO/IEC 15938-1. And the following classificatio

35、n scheme is defined for this purpose. MPEG7CameraMotion ISO/IEC 15938-3 Binary Camera Motion Codec MPEG7ColorLayout ISO/IEC 15938-3 Binary Color Layout Codec MPEG7ColorQuantization ISO/IEC 15938-3 Binary Color Quantization Codec MPEG7ColorSpace ISO/IEC 15938-3 Binary Color Space Codec MPEG7ColorStru

36、cture ISO/IEC 15938-3 Binary Color Structure Codec MPEG7ContourShape ISO/IEC 15938-3 Binary Contour Shape Codec MPEG7DominantColor ISO/IEC 15938-3 Binary Dominant Color Codec MPEG7EdgeHistogram ISO/IEC 15938-3 Binary Edge Histogram Codec MPEG7FaceRecognition Amendment 2:2007 toCAN/CSA-ISO/IEC 15938-

37、3:04ISO/IEC 15938-3:2002/Amd.2:2006(E) 4 ISO/IEC 2006 All rights reservedISO/IEC 15938-3 Binary Face Recognition Codec MPEG7FoFGoPColor ISO/IEC 15938-3 Binary GoFGoP Color Codec MPEG7GridLayout ISO/IEC 15938-3 Binary Grid Layout Codec MPEG7HomogeneousTexture ISO/IEC 15938-3 Binary Homogeneous Textur

38、e Codec MPEG7IrregularVisualTimeSeries ISO/IEC 15938-3 Binary Irregular Time Series Codec MPEG7MotionActivity ISO/IEC 15938-3 Binary Motion Activity Codec MPEG7MotionTrajectory ISO/IEC 15938-3 Binary Motion Trajectory Codec MPEG7MultipleView ISO/IEC 15938-3 Binary Multiple View Codec MPEG7Parametric

39、Motion ISO/IEC 15938-3 Binary Parametric Motion Codec MPEG7RegionLocator ISO/IEC 15938-3 Binary Region Locator Codec MPEG7RegionShape ISO/IEC 15938-3 Binary Region Shape Codec MPEG7RegularVisualTimeSeries ISO/IEC 15938-3 Binary Regular Time Series Codec MPEG7ScalableColor Amendment 2:2007 toCAN/CSA-

40、ISO/IEC 15938-3:04ISO/IEC 15938-3:2002/Amd.2:2006(E) ISO/IEC 2006 All rights reserved 5ISO/IEC 15938-3 Binary Scalable Color Codec MPEG7Shape3D ISO/IEC 15938-3 Binary Shape 3D Codec MPEG7Spatial2DCoordinateSystem ISO/IEC 15938-3 Binary Spatial 2D Coordinate System Codec MPEG7SpatioTemporalLocator IS

41、O/IEC 15938-3 Binary SpatioTemporal Locator Codec MPEG7TemporalInterpolation ISO/IEC 15938-3 Binary Temporal Interpolation Codec MPEG7TextureBrowsing ISO/IEC 15938-3 Binary Texture Browsing Codec MPEG7GofGopFeature ISO/IEC 15938-3 Binary Gof Gop Feature Codec MPEG7ColorTemperature ISO/IEC 15938-3 Bi

42、nary Color Temperature Codec MPEG7ShapeVariation ISO/IEC 15938-3 Binary Shape Variation Codec MPEG7IlluminationInvariantColor ISO/IEC 15938-3 Binary Illumination Invariant Color Codec MPEG7AdvancedFaceRecognition ISO/IEC 15938-3 Binary Advanced Face Recognition Codec MPEG7Perceptual3DShape ISO/IEC 1

43、5938-3 Binary Perceptual 3D Shape Codec Amendment 2:2007 toCAN/CSA-ISO/IEC 15938-3:04ISO/IEC 15938-3:2002/Amd.2:2006(E) 6 ISO/IEC 2006 All rights reservedReplace Table 1 in subclause 5.2.4 with: Table 1 Assignment of IDs to descriptors ID Descriptor 0 Forbidden 1 CameraMotion 2 ColorLayout 3 ColorSp

44、ace 4 ColorStructure 5 ColorQuantization6 ContourShape 7 DominantColor 8 EdgeHistogram 9 FaceRecognition 10 GoFGoPColor 11 GridLayout 12 HomogeneousTexture 13 IrregularVisualTimeSeries 14 MotionActivity 15 MotionTrajectory16 MultipleView 17 ParametricMotion 18 RegionLocator 19 RegionShape 20 Regular

45、VisualTimeSeries 21 ScalableColor 22 Shape3D 23 Spatial2DCoordinateSystem 24 SpatioTemporalLocator 25 TemporalInterpolation 26 TextureBrowsing 27 GofGopFeature 28 ColorTemperature 29 ShapeVariation 30 IlluminationInvariantColor 31 AdvancedFaceRecognition 32 Perceptual3DShape 33-255 Reserved Add afte

46、r subclause 8.5: 8.6 Perceptual 3D Shape The Perceptual 3D Shape descriptor is a part-based representation of a 3D object expressed as a graph. In this context “node” is a vertex in the graph representation corresponding to a part in the 3D model. Such a representation facilitates object description

47、 consistent with human perception. Compared with the Shape 3D descriptor, the Perceptual 3D Shape descriptor supports additional functionalities, like Query by sketch and Query by editing, which make the content-based retrieval system more interactive and efficient in querying and retrieving similar

48、 3D objects. Amendment 2:2007 toCAN/CSA-ISO/IEC 15938-3:04ISO/IEC 15938-3:2002/Amd.2:2006(E) ISO/IEC 2006 All rights reserved 78.6.1 DDL representation syntax Amendment 2:2007 toCAN/CSA-ISO/IEC 15938-3:04ISO/IEC 15938-3:2002/Amd.2:2006(E) 8 ISO/IEC 2006 All rights reserved8.6.2 Binary representation

49、 syntax Perceptual3DShape Number of bits Mnemonics NumOfNodes 8 uimsbf BitsPerAttribute 4 uimsbf for (i=0; i( NumOfNodes * NumOfNodes - NumOfNodes)/2; i+) IsConnectedi 1 bslbf For (i=0; i NumOfNodes; i+) Volumei BitsPerAttribute uimsbf Center_Xi BitsPerAttribute uimsbf Center_Yi BitsPerAttribute uimsbf Center_Zi BitsPerAttribute uimsbf PCA_Axis_1Xi BitsPerAttribute uimsbf PCA_Axis_1Yi BitsPerAttribute uimsbf PCA_Axis_1Zi BitsPerAttribute uimsbf PCA_Axis_2Xi BitsPerAttribute uimsbf PCA_Axi