1、Information technology Multimedia content description interface Part3: VisualAMENDMENT4:VideosignaturetoolsAmendment 4:2012 (IDT) toNational Standard of CanadaCAN/CSA-ISO/IEC 15938-3-04(ISO/IEC 15938-3:2002, IDT)NOT FOR RESALE.PUBLICATION NON DESTINE LA REVENTE.CSA Standards Update ServiceAmendment
2、4:2012 toCAN/CSA-ISO/IEC 15938-3-04March 2012Title:Information technology Multimedia cont ent description interface Part3: Visual AMENDMENT4:VideosignaturetoolsPagination:45 pages (iii preliminary and 42 text)To register for e-mail notification about any updates to this publication go on-line to sho
3、p.csa.caclick on E-mail Services under MY ACCOUNTclick on CSA Standards Update ServiceThe List ID that you will need to register for updates to this publication is 2416195.If you require assistance, please e-mail techsupportcsa.ca or call 416-747-2233.Visit CSAs policy on privacy at csagroup.org/leg
4、al to find out how we protect your personal information.Reference numberISO/IEC 15938-3:2002/Amd.4:2010(E)ISO/IEC 2010INTERNATIONAL STANDARD ISO/IEC15938-3First edition2002-05-15AMENDMENT 42010-10-15Information technology Multimedia content description interface Part 3: Visual AMENDMENT 4: Video sig
5、nature tools Technologies de linformation Interface de description du contenu multimdia Partie 3: Visuel AMENDEMENT 4: Outils de vidosignature ISO/IEC 15938-3:2002/Amd.4:2010(E) PDF disclaimer This PDF file may contain embedded typefaces. In accordance with Adobes licensing policy, this file may be
6、printed or viewed but shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading this file, parties accept therein the responsibility of not infringing Adobes licensing policy. The ISO Central Secretariat accepts n
7、o liability in this area. Adobe is a trademark of Adobe Systems Incorporated. Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation parameters were optimized for printing. Every care has been taken to ensure that the fil
8、e is suitable for use by ISO member bodies. In the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below. COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2010 All rights reserved. Unless otherwise specified, no part of this publication may be re
9、produced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 2
10、2 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.org ii ISO/IEC 2010 All rights reservedAmendment 4:2012 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.4:2010(E) ISO/IEC 2010 All rights reserved iiiForeword ISO (the International Organization for Standardization) and IEC
11、(the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with par
12、ticular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO and IEC have est
13、ablished a joint technical committee, ISO/IEC JTC 1. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2. The main task of the joint technical committee is to prepare International Standards. Draft International Standards adopted by the joint tech
14、nical committee are circulated to national bodies for voting. Publication as an International Standard requires approval by at least 75 % of the national bodies casting a vote. Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO a
15、nd IEC shall not be held responsible for identifying any or all such patent rights. Amendment 4 to ISO/IEC 15938-3:2002 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology, Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information. Amendment 4:20
16、12 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.4:2010(E) ISO/IEC 2010 All rights reserved 1Information technology Multimedia content description interface Part 3: Visual AMENDMENT 4: Video signature tools Replace 1.2 with: 1.2 Overview of Visual Description Tools This part of ISO/IEC 15938
17、 specifies tools for description of visual content, including still images, video and 3D models. These tools are defined by their syntax in DDL and binary representations and semantics associated with the syntactic elements. They enable description of the visual features of the visual material, such
18、 as color, texture, shape, motion, localization of the described objects in the image or video sequence and also unique and robust identification of visual material. An overview of the visual description tools is shown in Figure 1. The basic structure description tools include five supporting tools
19、of visual descriptions defined in Clauses 6-11. They are categorized into two groups, descriptor containers and basic supporting tools. The former consists of three datatypes, GridLayout providing efficient representations of visual features on grids, TimeSeries representing temporal arrays of sever
20、al descriptions, GofGopFeature describes representative descriptions over video segment, and MultipleView describing a 3D object using several pictures captured from different view angles. The latter contains two tools, Spatial2DcoordinateSystem used to specify the 2D coordinate system and TemporalI
21、nterpolation indicating the interpolation method between two samples on a time axis. The remaining description tools, except for the FaceRecognition and ImageSignature descriptors, are associated with visual features and are grouped into five feature categories: Color, Texture, Shape, Motion and Loc
22、alization. The color description tools include five color descriptors to represent different aspects of color features: representative colors (DominantColor), color distribution (ScalableColor), spatial distribution of colors (ColorLayout and ColorStructure) and perceptual feeling of illumination co
23、lor (ColorTemperature). It also contains three supporting tools, ColorSpace and ColorQuantization used in DominantColor and IlluminationInvariantColor to extend four color descriptors, DominantColor, ScalableColor, ColorLayout and ColorStructure, to support illumination invariant similarity matching
24、. An extension of ScalableColor to a group of frames or pictures (GoFGoPColor) is also included in this group. All the color descriptors can be extracted from arbitrarily shaped regions. The texture description tools facilitate browsing (TextureBrowsing) and similarity retrieval (HomogeneousTexture
25、and EdgeHistogram) using the texture of a still or moving image region. All the texture descriptors can be extracted from arbitrarily shaped regions. The shape description tools include two descriptors that characterize different shape features of a 2D object or region. The RegionShape descriptor ca
26、ptures the distribution of all pixels within a region and the Contour Shape descriptor characterizes the shape properties of the contour of an object. The extension of RegionShape is also defined as ShapeVariation to describe temporal variation of shape over video segment. The Shape3D and Perceptual
27、 3D Shape descriptors provide 3-dimensional shape information; the former Amendment 4:2012 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.4:2010(E) 2 ISO/IEC 2010 All rights reservedrepresents an intrinsic shape characterization of 3D mesh models, and the latter represents part-based represen
28、tation of a 3D object. The motion description tools include four descriptors that characterize various aspects of motion. The CameraMotion descriptor specifies a set of basic camera operations such as, for example, panning and tilting. The motion of a key point (pixel) from a moving object or region
29、 can be characterized by the MotionTrajectory descriptor. The ParametricMotion descriptor characterizes an evolution of an arbitrarily shaped region over time in terms of a 2D geometric transformation. Finally, the MotionActivity descriptor captures the pace of the motion in the sequence, as perceiv
30、ed by the viewer. All motion descriptors except for CameraMotion can be extracted from arbitrarily shaped regions. The localization description tools can be used to indicate regions of interest in the spatial (RegionLocator) and spatio-temporal (SpatioTemporalLocator) domains. The FaceRecognition de
31、scriptor and the Advanced Face Recognition descriptor are not associated with any particular visual feature and can be used to describe a human face for applications requiring the matching and retrieval of face images. The signature descriptors provide a “fingerprint“ that uniquely identifies image
32、and video content. The signatures are robust (unchanging) across a wide range of common editing operations, but are sufficiently different for every item of “original“ content to allow unique and reliable identification just like human fingerprints. There are two visual signatures; the ImageSignatur
33、e and VideoSignature are descriptors for images and videos respectively. The signatures have no direct association with specific visual features such as colour, shape or texture. Amendment 4:2012 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.4:2010(E) ISO/IEC 2010 All rights reserved 3Figure
34、 1 Overview of Visual Description Tools In 3.3, extend the definitions: floor Maximum integer number less than or equal to the given floating point number Replace 4.2.2 with: 4.2.2 Generic binary representation The use of the video-specific syntax is signalled using the codec configuration mechanism
35、 defined in ISO/IEC 15938-1. The following classification scheme is defined for this purpose. Basic Structures Descriptor Containers GridLayout TimeSeries MultipleViewBasic Supporting ToolsTemporalInterpolationSpatial2DcoordinateSystemColor Color Feature DescriptorsDominantColor ScalableColor ColorL
36、ayout ColorStructure GofGopColorColor Supporting ToolsColorSpaceColorQuantizationTexture HomogeneousTexture TextureBrowsing EdgeHistogram Motion CameraMotion MotionTrajectory ParametricMotion MotionActivity Localization RegionLocator SpatioTemporalLocator RegionShapeContourShapeShape3DShapeVisual Fe
37、atures GofGopFeature ShapeVariationOther FaceRecognition AdvancedFaceRecognition ColorTemperature Perceptual 3D Shape IlluminationInvariantColorSignaturesImageSignatureVideoSignatureAmendment 4:2012 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.4:2010(E) 4 ISO/IEC 2010 All rights reservedMPE
38、G7CameraMotion ISO/IEC 15938-3 Binary Camera Motion Codec MPEG7ColorLayout ISO/IEC 15938-3 Binary Color Layout Codec MPEG7ColorQuantization ISO/IEC 15938-3 Binary Color Quantization Codec MPEG7ColorSpace ISO/IEC 15938-3 Binary Color Space Codec MPEG7ColorStructure ISO/IEC 15938-3 Binary Color Struct
39、ure Codec MPEG7ContourShape ISO/IEC 15938-3 Binary Contour Shape Codec MPEG7DominantColor ISO/IEC 15938-3 Binary Dominant Color Codec MPEG7EdgeHistogram ISO/IEC 15938-3 Binary Edge Histogram Codec MPEG7FaceRecognition ISO/IEC 15938-3 Binary Face Recognition Codec MPEG7FoFGoPColor ISO/IEC 15938-3 Bin
40、ary GoFGoP Color Codec MPEG7GridLayout ISO/IEC 15938-3 Binary Grid Layout Codec MPEG7HomogeneousTexture ISO/IEC 15938-3 Binary Homogeneous Texture Codec Amendment 4:2012 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.4:2010(E) ISO/IEC 2010 All rights reserved 5MPEG7IrregularVisualTimeSeries I
41、SO/IEC 15938-3 Binary Irregular Time Series Codec MPEG7MotionActivity ISO/IEC 15938-3 Binary Motion Activity Codec MPEG7MotionTrajectory ISO/IEC 15938-3 Binary Motion Trajectory Codec MPEG7MultipleView ISO/IEC 15938-3 Binary Multiple View Codec MPEG7ParametricMotion ISO/IEC 15938-3 Binary Parametric
42、 Motion Codec MPEG7RegionLocator ISO/IEC 15938-3 Binary Region Locator Codec MPEG7RegionShape ISO/IEC 15938-3 Binary Region Shape Codec MPEG7RegularVisualTimeSeries ISO/IEC 15938-3 Binary Regular Time Series Codec MPEG7ScalableColor ISO/IEC 15938-3 Binary Scalable Color Codec MPEG7Shape3D ISO/IEC 15
43、938-3 Binary Shape 3D Codec MPEG7Spatial2DCoordinateSystem ISO/IEC 15938-3 Binary Spatial 2D Coordinate System Codec MPEG7SpatioTemporalLocator ISO/IEC 15938-3 Binary SpatioTemporal Locator Codec Amendment 4:2012 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.4:2010(E) 6 ISO/IEC 2010 All righ
44、ts reservedMPEG7TemporalInterpolation ISO/IEC 15938-3 Binary Temporal Interpolation Codec MPEG7TextureBrowsing ISO/IEC 15938-3 Binary Texture Browsing Codec MPEG7GofGopFeature ISO/IEC 15938-3 Binary Gof Gop Feature Codec MPEG7ColorTemperature ISO/IEC 15938-3 Binary Color Temperature Codec MPEG7Shape
45、Variation ISO/IEC 15938-3 Binary Shape Variation Codec MPEG7IlluminationInvariantColor ISO/IEC 15938-3 Binary Illumination Invariant Color Codec MPEG7AdvancedFaceRecognition ISO/IEC 15938-3 Binary Advanced Face Recognition Codec MPEG7Perceptual3DShape ISO/IEC 15938-3 Binary Perceptual 3D Shape Codec
46、 MPEG7ImageSignature ISO/IEC 15938-3 Binary Image Signature Codec MPEG7VideoSignature ISO/IEC 15938-3 Binary Video Signature Codec Amendment 4:2012 to CAN/CSA-ISO/IEC 15938-3-04ISO/IEC 15938-3:2002/Amd.4:2010(E) ISO/IEC 2010 All rights reserved 7In 5.2.4, replace Table 1 with: Table 1 Assignment of
47、IDs to descriptors ID Descriptor 0 Forbidden 1 CameraMotion 2 ColorLayout 3 ColorSpace 4 ColorStructure 5 ColorQuantization 6 ContourShape 7 DominantColor 8 EdgeHistogram9 FaceRecognition 10 GoFGoPColor 11 GridLayout12 HomogeneousTexture 13 IrregularVisualTimeSeries 14 MotionActivity 15 MotionTrajec
48、tory16 MultipleView 17 ParametricMotion 18 RegionLocator 19 RegionShape 20 RegularVisualTimeSeries 21 ScalableColor 22 Shape3D 23 Spatial2DCoordinateSystem24 SpatioTemporalLocator 25 TemporalInterpolation 26 TextureBrowsing 27 GofGopFeature 28 ColorTemperature 29 ShapeVariation 30 IlluminationInvari
49、antColor 31 AdvancedFaceRecognition32 Perceptual3DShape 33 ImageSignature 34 VideoSignature 35-255 Reserved After 11.3, add the following: 11.4 Video Signature 11.4.1 Introduction The visual content descriptors in Sections 6-9 are very useful when trying to find videos with similar content. These descriptors are intended to be general and were found to be unsuitable for the task of finding duplicate content. The video signature descriptor is designed to identify duplicate video content. This descriptor is robust (
