CAN CSA-ISO IEC 15938-3C-2010 Information technology - Multimedia content description interface - Part 3 Visual - AMENDMENT 3 Image signature tools.pdf

1、Information technology Multimedia content description interface Part 3: Visual AMENDMENT 3: Image signature toolsAmendment 3:2010 (IDT) toNational Standard of CanadaCAN/CSA-ISO/IEC 15938-3-04(ISO/IEC 15938-3:2004, IDT)NOT FOR RESALE.PUBLICATION NON DESTINE LA REVENTE.CSA Standards Update ServiceAmen

2、dment 3:2010 toCAN/CSA-ISO/IEC 15938-3-04December 2010Title:Information technology Mul timedia content description interface Part 3: Visual AMENDMENT 3: Image signature toolsPagination:22 pages (iii preliminary and 19 text)To register for e-mail notification about any updates to this publicationgo t

3、o www.shopcsa.caclick on E-mail Services under MY ACCOUNTclick on CSA Standards Update ServiceThe List ID that you will need to register for updates to this publication is 2416195.If you require assistance, please e-mail techsupportcsa.ca or call 416-747-2233.Visit CSAs policy on privacy at www.csag

4、roup.org/legal to find out how we protect your personal information.Reference numberISO/IEC 15938-3:2002/Amd.3:2009(E)ISO/IEC 2009INTERNATIONAL STANDARD ISO/IEC15938-3First edition2002-05-15AMENDMENT 32009-04-01Information technology Multimedia content description interface Part 3: Visual AMENDMENT

5、3: Image signature tools Technologies de linformation Interface de description du contenu multimdia Partie 3: Visuel AMENDEMENT 3: Outils de signature dimage ISO/IEC 15938-3:2002/Amd.3:2009(E) PDF disclaimer This PDF file may contain embedded typefaces. In accordance with Adobes licensing policy, th

6、is file may be printed or viewed but shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading this file, parties accept therein the responsibility of not infringing Adobes licensing policy. The ISO Central Secret

7、ariat accepts no liability in this area. Adobe is a trademark of Adobe Systems Incorporated. Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation parameters were optimized for printing. Every care has been taken to ensu

8、re that the file is suitable for use by ISO member bodies. In the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below. COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2009 All rights reserved. Unless otherwise specified, no part of this public

9、ation may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Case postale 56 CH-1211 Geneva

10、 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.org ii ISO/IEC 2009 All rights reservedAmendment 3:2010 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.3:2009(E) ISO/IEC 2009 All rights reserved iiiForeword ISO (the International Organization for Standardiz

11、ation) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization t

12、o deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO a

13、nd IEC have established a joint technical committee, ISO/IEC JTC 1. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2. The main task of the joint technical committee is to prepare International Standards. Draft International Standards adopted by

14、 the joint technical committee are circulated to national bodies for voting. Publication as an International Standard requires approval by at least 75 % of the national bodies casting a vote. Attention is drawn to the possibility that some of the elements of this document may be the subject of paten

15、t rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. Amendment 3 to ISO/IEC 15938-3:2002 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology, Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.

16、 Amendment 3:2010 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.3:2009(E) ISO/IEC 2009 All rights reserved 1Information technology Multimedia content description interface Part 3: Visual AMENDMENT 3: Image signature tools Page 1, Scope Replace 1.2 entirely with the following: 1.2 Overview of

17、 Visual Description Tools This part of ISO/IEC 15938 specifies tools for description of visual content, including still images, video and 3D models. These tools are defined by their syntax in DDL and binary representations and semantics associated with the syntactic elements. They enable description

18、 of the visual features of the visual material, such as color, texture, shape, motion, localization of the described objects in the image or video sequence and also unique and robust identification of visual material. An overview of the visual description tools is shown in Figure 1. The basic struct

19、ure description tools include five supporting tools of visual descriptions defined in clauses 6-11. They are categorized into two groups, descriptor containers and basic supporting tools. The former consists of three datatypes, GridLayout providing efficient representations of visual features on gri

20、ds, TimeSeries representing temporal arrays of several descriptions, GofGopFeature describes representative descriptions over video segment, and MultipleView describing a 3D object using several pictures captured from different view angles. The latter contains two tools, Spatial2DcoordinateSystem us

21、ed to specify the 2D coordinate system and TemporalInterpolation indicating the interpolation method between two samples on a time axis. The remaining description tools, except for the FaceRecognition and ImageSignature descriptors, are associated with visual features and are grouped into five featu

22、re categories: Color, Texture, Shape, Motion and Localization. The color description tools include five color descriptors to represent different aspects of color features: representative colors (DominantColor), color distribution (ScalableColor), spatial distribution of colors (ColorLayout and Color

23、Structure) and perceptual feeling of illumination color (ColorTemperature). It also contains three supporting tools, ColorSpace and ColorQuantization used in DominantColor and IlluminationInvariantColor to extend four color descriptors, DominantColor, ScalableColor, ColorLayout and ColorStructure, t

24、o support illumination invariant similarity matching. An extension of ScalableColor to a group of frames or pictures (GoFGoPColor) is also included in this group. All the color descriptors can be extracted from arbitrarily shaped regions. The texture description tools facilitate browsing (TextureBro

25、wsing) and similarity retrieval (HomogeneousTexture and EdgeHistogram) using the texture of a still or moving image region. All the texture descriptors can be extracted from arbitrarily shaped regions. The shape description tools include two descriptors that characterize different shape features of

26、a 2D object or region. The RegionShape descriptor captures the distribution of all pixels within a region and the Contour Amendment 3:2010 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.3:2009(E) 2 ISO/IEC 2009 All rights reservedShape descriptor characterizes the shape properties of the cont

27、our of an object. The extension of RegionShape is also defined as ShapeVariation to describe temporal variation of shape over video segment. The Shape3D and Perceptual 3D Shape descriptors provide 3-dimensional shape information; the former represents an intrinsic shape characterization of 3D mesh m

28、odels, and the latter represents part-based representation of a 3D object. The motion description tools include four descriptors that characterize various aspects of motion. The CameraMotion descriptor specifies a set of basic camera operations such as, for example, panning and tilting. The motion o

29、f a key point (pixel) from a moving object or region can be characterized by the MotionTrajectory descriptor. The ParametricMotion descriptor characterizes an evolution of an arbitrarily shaped region over time in terms of a 2D geometric transformation. Finally, the MotionActivity descriptor capture

30、s the pace of the motion in the sequence, as perceived by the viewer. All motion descriptors except for CameraMotion can be extracted from arbitrarily shaped regions. The localization description tools can be used to indicate regions of interest in the spatial (RegionLocator) and spatio-temporal (Sp

31、atioTemporalLocator) domains. The FaceRecognition descriptor and the Advanced Face Recognition descriptor are not associated with any particular visual feature and can be used to describe a human face for applications requiring the matching and retrieval of face images. The ImageSignature descriptor

32、 provides a “fingerprint“ of an image that uniquely identify it. The signature is robust (unchanging) across a wide range of common editing operations, but is sufficiently different for every item of “original“ content to identify it uniquely and reliably just like human fingerprints. The ImageSigna

33、ture has no direct association with specific visual features such as colour, shape or texture. Amendment 3:2010 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.3:2009(E) ISO/IEC 2009 All rights reserved 3Figure 1 Overview of Visual Description Tools Basic Structures Descriptor Containers GridL

34、ayout TimeSeries MultipleViewBasic Supporting ToolsTemporalInterpolationSpatial2DcoordinateSystemColor Color Feature Descriptors DominantColor ScalableColorColorLayoutColorStructureGofGopColorColor Supporting ToolsColorSpaceColorQuantizationTexture HomogeneousTexture TextureBrowsing EdgeHistogramMot

35、ion CameraMotion MotionTrajectory ParametricMotion MotionActivity LocalizationRegionLocatorSpatioTemporalLocator RegionShapeContourShapeShape3DShapeVisual Features GofGopFeatureShapeVariationOther FaceRecognitionAdvancedFaceRecognition ColorTemperature Perceptual 3D Shape IlluminationInvariantColorS

36、ignaturesImageSignatureAmendment 3:2010 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.3:2009(E) 4 ISO/IEC 2009 All rights reservedReplace 3.2 with: 3.2 Abbreviations ART Angular-Radial Transform CSS Curvature Scale Space DDL Description Definition Language DS Description Scheme D Descriptor

37、DCT Discrete Cosine Transform FOC Focus of Contraction FOE Focus of Expansion FFT Fast Fourier Transform GoF Group of Frames GoP Group of Pictures HMMD Hue-Min-Max-Difference HSV Hue-Saturation-Value RGB Red-Green-Blue Replace 4.2.2 with: 4.2.2 Generic binary representation The use of the video-spec

38、ific syntax is signalled using the codec configuration mechanism defined in ISO/IEC 15938-1. The following classification scheme is defined for this purpose. MPEG7CameraMotion ISO/IEC 15938-3 Binary Camera Motion Codec MPEG7ColorLayout ISO/IEC 15938-3 Binary Color Layout Codec MPEG7ColorQuantization

39、 ISO/IEC 15938-3 Binary Color Quantization Codec MPEG7ColorSpace ISO/IEC 15938-3 Binary Color Space Codec MPEG7ColorStructure ISO/IEC 15938-3 Binary Color Structure Codec MPEG7ContourShape ISO/IEC 15938-3 Binary Contour Shape Codec Amendment 3:2010 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/A

40、md.3:2009(E) ISO/IEC 2009 All rights reserved 5MPEG7DominantColor ISO/IEC 15938-3 Binary Dominant Color Codec MPEG7EdgeHistogram ISO/IEC 15938-3 Binary Edge Histogram Codec MPEG7FaceRecognition ISO/IEC 15938-3 Binary Face Recognition Codec MPEG7FoFGoPColor ISO/IEC 15938-3 Binary GoFGoP Color Codec M

41、PEG7GridLayout ISO/IEC 15938-3 Binary Grid Layout Codec MPEG7HomogeneousTexture ISO/IEC 15938-3 Binary Homogeneous Texture Codec MPEG7IrregularVisualTimeSeries ISO/IEC 15938-3 Binary Irregular Time Series Codec MPEG7MotionActivity ISO/IEC 15938-3 Binary Motion Activity Codec MPEG7MotionTrajectory IS

42、O/IEC 15938-3 Binary Motion Trajectory Codec MPEG7MultipleView ISO/IEC 15938-3 Binary Multiple View Codec MPEG7ParametricMotion ISO/IEC 15938-3 Binary Parametric Motion Codec MPEG7RegionLocator ISO/IEC 15938-3 Binary Region Locator Codec Amendment 3:2010 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:

43、2002/Amd.3:2009(E) 6 ISO/IEC 2009 All rights reservedMPEG7RegionShape ISO/IEC 15938-3 Binary Region Shape Codec MPEG7RegularVisualTimeSeries ISO/IEC 15938-3 Binary Regular Time Series Codec MPEG7ScalableColor ISO/IEC 15938-3 Binary Scalable Color Codec MPEG7Shape3D ISO/IEC 15938-3 Binary Shape 3D Co

44、dec MPEG7Spatial2DCoordinateSystem ISO/IEC 15938-3 Binary Spatial 2D Coordinate System Codec MPEG7SpatioTemporalLocator ISO/IEC 15938-3 Binary SpatioTemporal Locator Codec MPEG7TemporalInterpolation ISO/IEC 15938-3 Binary Temporal Interpolation Codec MPEG7TextureBrowsing ISO/IEC 15938-3 Binary Textu

45、re Browsing Codec MPEG7GofGopFeature ISO/IEC 15938-3 Binary Gof Gop Feature Codec MPEG7ColorTemperature ISO/IEC 15938-3 Binary Color Temperature Codec MPEG7ShapeVariation ISO/IEC 15938-3 Binary Shape Variation Codec MPEG7IlluminationInvariantColor ISO/IEC 15938-3 Binary Illumination Invariant Color

46、Codec Amendment 3:2010 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.3:2009(E) ISO/IEC 2009 All rights reserved 7MPEG7AdvancedFaceRecognition ISO/IEC 15938-3 Binary Advanced Face Recognition Codec MPEG7Perceptual3DShape ISO/IEC 15938-3 Binary Perceptual 3D Shape Codec MPEG7ImageSignature ISO

47、/IEC 15938-3 Binary Image Signature Codec In 5.2.4, replace Table 1 with: Table 1 Assignment of IDs to descriptors ID Descriptor 0 Forbidden 1 CameraMotion 2 ColorLayout 3 ColorSpace 4 ColorStructure 5 ColorQuantization 6 ContourShape 7 DominantColor 8 EdgeHistogram9 FaceRecognition 10 GoFGoPColor 1

48、1 GridLayout12 HomogeneousTexture 13 IrregularVisualTimeSeries 14 MotionActivity 15 MotionTrajectory16 MultipleView 17 ParametricMotion 18 RegionLocator 19 RegionShape 20 RegularVisualTimeSeries 21 ScalableColor 22 Shape3D 23 Spatial2DCoordinateSystem24 SpatioTemporalLocator 25 TemporalInterpolation

49、 26 TextureBrowsing 27 GofGopFeature 28 ColorTemperature 29 ShapeVariation 30 IlluminationInvariantColor 31 AdvancedFaceRecognition32 Perceptual3DShape 33 ImageSignature 34-255 Reserved Amendment 3:2010 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.3:2009(E) 8 ISO/IEC 2009 All rights reservedAfter 11.2, add the following: 1.3 Image Signature 11.3.1 Introduction Most visual descriptors are very useful when trying to find images with similar content however, such descriptions are intended to be gen