1、Information technology Multimedia content description interface Part 9: Profiles and levels AMENDMENT 1: Extensions to profiles and levelsAmendment 1:2013 (IDT) toNational Standard of CanadaCAN/CSA-ISO/IEC 15938-9-07(ISO/IEC 15938-9:2005, IDT)NOT FOR RESALE. / PUBLICATION NON DESTINE LA REVENTE.Stan
2、dards Update ServiceAmendment 1:2013 toCAN/CSA-ISO/IEC 15938-9-07January 2013Title:Information technology Multimedia content description interface Part 9: Profiles and levels AMENDMENT 1: Extensions to profiles and levelsPagination:47 pages (iii preliminary and 46 text)To register for e-mail notific
3、ation about any updates to this publicationgo to shop.csa.caclick on CSA Update ServiceThe List ID that you will need to register for updates to this publication is 2422262.If you require assistance, please e-mail techsupportcsagroup.org or call 416-747-2233.Visit CSA Groups policy on privacy at csa
4、group.org/legal to find out how we protect your personal information.Reference numberISO/IEC 15938-9:2005/Amd.1:2012(E)ISO/IEC 2012INTERNATIONAL STANDARD ISO/IEC15938-9First edition2005-04-01AMENDMENT 12012-06-01Information technology Multimedia content description interface Part 9: Profiles and lev
5、els AMENDMENT 1: Extensions to profiles and levels Technologies de linformation Interface de description du contenu multimdia Partie 9: Profils et niveaux AMENDEMENT 1: Extensions aux profils et niveaux ISO/IEC 15938-9:2005/Amd.1:2012(E) COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2012 All rights reserved.
6、 Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISOs member body in the country of the requester.
7、ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.org ii ISO/IEC 2012 All rights reservedAmendment 1:2013 to CAN/CSA-ISO/IEC 15938-9-07ISO/IEC 15938-9:2005/Amd.1:2012(E) ISO/IEC 2012 All rights reserved iiiForeword
8、 ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC participate in the development of International Standards through technical comm
9、ittees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
10、work. In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2. The main task of the joint technical committee is to prepare International
11、Standards. Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as an International Standard requires approval by at least 75 % of the national bodies casting a vote. Attention is drawn to the possibility that some of the el
12、ements of this document may be the subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. Amendment 1 to ISO/IEC 15938-9:2005 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology, Subcommittee SC 29, Coding of aud
13、io, picture, multimedia and hypermedia information. Amendment 1:2013 to CAN/CSA-ISO/IEC 15938-9-07Amendment 1:2013 to CAN/CSA-ISO/IEC 15938-9-07ISO/IEC 15938-9:2005/Amd.1:2012(E) ISO/IEC 2012 All rights reserved 1Information technology Multimedia content description interface Part 9: Profiles and le
14、vels AMENDMENT 1: Extensions to profiles and levels After 4.4, add the following subclauses: 4.5 AudioVisual Description Profile (AVDP) 4.5.1 Application Areas The description tools in this profile can be used to describe the results of various kinds of media analysis with visual and audio low-level
15、 features. Consequently the information resulting from media analysis, such as shot/scene detection, face recognition/tracking, speech recognition, copy detection and summarisation, can be used in a wide range of applications such as archive management, news, new services for new media, and many aca
16、demic projects handling large scale video content, e.g. benchmarking initiatives. The goal is to support establishing an environment where users can exchange evaluation results of media analysis, hence helping the introduction of automatic media analysis tools into many application areas. 4.5.2 Func
17、tionality The main functionality of this profile is describing the results of automatic media analysis with low-, mid- and high-level features for audio-visual content. The profile supports high-level functionalities such as (but not limited to) the following: Provides tools for describing feature e
18、xtraction tool, version, contributors, and the date/time the tool applied Provides tools for describing several results with confidence levels in multiple timelines. Provides tools for describing the results of segmentation, text recognition, person identification, format detection, genre detection,
19、 keyword extraction, speech recognition, and subject classification. Provides tools for describing the results of copy detection and summarization with having several descriptions of audio-visual contents in one document. 4.5.3 Tools in the Profile This profile is defined with respect to the Version
20、 2 schema as specified in ISO/IEC 15938-10. The namespace of the Version 2 schema providing a basis for this profile is “urn:mpeg:mpeg7:schema:2004.” The following table lists the ISO/IEC 15938 description tools (global elements, global attributes, attribute groups, complexTypes and simpleTypes) and
21、 the profile constraints that are part of this profile. Amendment 1:2013 to CAN/CSA-ISO/IEC 15938-9-07ISO/IEC 15938-9:2005/Amd.1:2012(E) 2 ISO/IEC 2012 All rights reservedTable AMD 1.1 Description Profile Tool for AVDP Global Elements Name Constraint Mpeg7 DescriptionUnit element excludedDescription
22、 The document may contain an unlimited number of content descriptions (e.g. for describing a set of contents which contain copies and need to be cross-referenced, or for referencing source segments from a summary). At most one of these descriptions can be of type SummaryDescriptionType. Global Attri
23、butes Name Constraint dim Global Attribute Groups Name Constraint audioSpectrumAttributeGrp mediaTimePropertyGrp mediaTimeBase The XPath shall not contain axis specifiers, i.e. it excludes elements 5 and 6 from the datatype definition in Annex A.1 of ISO/IEC 15938-5. On the root a/v segment, mediaTi
24、meBase may only point to a MediaLocator element in the same description, i.e. the value is limited to be one of MediaLocator MediaInformation/MediaProfile/MediaInstancei/MediaLocator where i is integer, and can be omitted if only one profile/instance exists. referenceGrp idref attribute excludedhref
25、 attribute excludedxpath ReferenceType is only used in Availability/InstanceRef. The value of the xpath attribute shall be “/MediaInformation/ MediaProfile/MediaInstancei” where i is integer, and can be omitted if only one profile/instance exists. Amendment 1:2013 to CAN/CSA-ISO/IEC 15938-9-07ISO/IE
26、C 15938-9:2005/Amd.1:2012(E) ISO/IEC 2012 All rights reserved 3Complex Types Name Constraint AdvancedFaceRecognitionType AgentType Icon element excluded AudioBPMType AudioDSType AudioDType AudioFundamentalFrequencyType AudioHarmonicityType AudioLLDScalarType AudioLLDVectorType AudioPowerType AudioSe
27、gmentTemporalDecompositionType AudioSegmentRef element excluded AudioSegmentType MediaTime minOccurs = “1“ TemporalMask element excluded MediaSourceDecomposition element excluded AudioSignalQualityType AudioSignatureType AudioSpectrumBasisType AudioSpectrumCentroidType AudioSpectrumEnvelopeType Audi
28、oSpectrumFlatnessType AudioSpectrumProjectionType AudioSpectrumSpreadType Amendment 1:2013 to CAN/CSA-ISO/IEC 15938-9-07ISO/IEC 15938-9:2005/Amd.1:2012(E) 4 ISO/IEC 2012 All rights reservedAudioSummaryComponentType Title element excluded a)AudioSourceID minOccurs = “1“; AudioSourceID is defined to r
29、eference MediaInformation/MediaProfile/ MediaInstancei/InstanceIdentifier, where i is integer, of the root content segment of a content description. AudioSourceLocator minOccurs = “1“ ComponentSourceTime element excluded SoundLocator element excludedSyncTime element excluded AudioTempoType AudioVisu
30、alSegmentMediaSourceDecompositionType AudioVisualSegment element excluded AudioVisualSegmentRef element excluded VideoSegmentRef element excludedStillRegionRef element excluded AudioSegmentRef element excludedAudioVisualSegmentTemporalDecompositionType AudioVisualSegmentRef element excluded AudioVis
31、ualRegion element excludedAudioVisualRegionRef element excluded AudioVisualSegmentType MediaTime minOccurs = “1“ TemporalMask element excluded SpatialDecomposition element excluded SpatioTemporalDecomposition element excluded AudioVisualType AudioWaveformType AvailabilityType Financial element exclu
32、ded Rights element excludedBackgroundNoiseLevelType BalanceType BandwidthType Amendment 1:2013 to CAN/CSA-ISO/IEC 15938-9-07ISO/IEC 15938-9:2005/Amd.1:2012(E) ISO/IEC 2012 All rights reserved 5BoxListType CameraMotionSegmentType CameraMotionType ClassificationType Release element excluded Target ele
33、ment excludedParentalGuidance element excluded MediaReview element excludedColorLayoutType ColorQuantizationType ColorSamplingType ColorSpaceType ColorStructureType ColorTemperatureType CompleteDescriptionType DescriptionMetadata element excluded Relationships element excludedOrderingKey element exc
34、luded ConfusionCountType ContentAbstractionType ContentDescriptionType ContentEntityType MultimediaContent maxOccurs = “1“ ContourShapeType ControlledTermUseType CreationInformationType CreationToolType CreationType TitleMedia may only be used on the root a/v segment CreatorType CrossChannelCorrelat
35、ionType Amendment 1:2013 to CAN/CSA-ISO/IEC 15938-9-07ISO/IEC 15938-9:2005/Amd.1:2012(E) 6 ISO/IEC 2012 All rights reservedDSType Header The following headers may be used: Description Metadata A complete DescriptionMetadata DS is required on each top level temporal decomposition, and optional on the
36、 root a/v segment. A description metadata element that only specifies the Confidence of a description scheme, may be used on any segment whenever the description scheme does not provide any other means to specify the confidence of the description. It is assumed that the confidence levels are not nor
37、malised across tools and thus they are not directly comparable. The Confidence shall not occur in description metadata headers in summaries. Headers from part 3 and 4 types may be used on any segment. The use of Header is prohibited on all other elements. id IDs shall be used on the following elemen
38、ts: All segments Top-level temporal decompositions IDs may be used on any other description scheme. timePropertyGrp attribute group excluded mediaTimePropertyGrp mediaTimePropertyGrp shall be used on the root a/v segment, and allowed only on TemporalDecompositionType, SpatioTemporalDecomposition-Typ
39、e SummarizationType and SummaryType. If SummarizationType has mediaTimepropertyGrp, each of the SummaryType elements may have mediaTimePropertyGrp, otherwise each of the element shall have mediaTimePropertyGrp. DType Amendment 1:2013 to CAN/CSA-ISO/IEC 15938-9-07ISO/IEC 15938-9:2005/Amd.1:2012(E) IS
40、O/IEC 2012 All rights reserved 7DcOffsetType DescriptionMetadataType Package element excluded * At least one element shall be present. DescriptionProfileType DisseminationType DominantColorType DoubleDiagonalMatrixType DoubleMatrixType EdgeHistogramType ElectronicAddressType ErrorEventType ExtendedL
41、anguageType FaceRecognitionType FigureTrajectoryType FloatDiagonalMatrixType FloatMatrixType FocusOfExpansionType FractionalPresenceType GeographicPointType GoFGoPColorType GofGopFeatureType GridLayoutTypeHarmonicInstrumentTimbreType HarmonicSpectralCentroidType HarmonicSpectralDeviationType Harmoni
42、cSpectralSpreadType HarmonicSpectralVariationType HeaderType Amendment 1:2013 to CAN/CSA-ISO/IEC 15938-9-07ISO/IEC 15938-9:2005/Amd.1:2012(E) 8 ISO/IEC 2012 All rights reservedHierarchicalSummaryType SummaryThemeList element excluded SummarySegmentGroupRef element excluded components attribute exclu
43、dedhierarchy fixed=“dependent“ HomogeneousTextureType IlluminationInvariantColorType ImageLocatorType MediaTimePoint element excluded MediaRelTimePoint element excludedBytePosition element excluded ImageTextType InlineTermDefinitionType Name (See footnote) b) Definition element excludedTerm element
44、excludedInstrumentTimbreType IntegerDiagonalMatrixType IntegerMatrixType IrregularVisualTimeSeriesType KeyType KeywordAnnotationType LexiconType LogAttackTimeType MediaAgentType AgentRef element excluded MediaFormatType Medium element excludedSystem elemen excludedBandwidth element excluded TargetCh
45、annelBitRate element excludedScalableCoding element excluded Emphasis element excludedPresentation element excluded SceneCodingFormat element excludedGraphicsCodingFormat element excluded OtherCodingFormat element excludedAmendment 1:2013 to CAN/CSA-ISO/IEC 15938-9-07ISO/IEC 15938-9:2005/Amd.1:2012(
46、E) ISO/IEC 2012 All rights reserved 9MediaIdentificationType AudioDomain element excluded VideoDomain element excludedImageDomain element excluded MediaIncrDurationType mediaTimeUnit attribute excluded The value of the mediaTimeUnit attribute on the closest parent TemporalDecomposition or Spatiotemp
47、oralDecomposition element applies. If the attribute is not present on any of the parent TemporalDecomposition or SpatiotemporalDecomposition elements, the value of the mediaTimeUnit attribute of the root a/v segment shall be used. MediaInformationType MediaProfile maxOccurs = “1“ MediaInstanceType L
48、ocationDescription element excluded MediaLocatorType InlineMedia element excludedMediaProfileType MediaTranscodingHints element excluded master attribute excludedMediaQualityType RatingInformationLocator element excluded MediaRelIncrTimePointType mediaTimeUnit attribute excluded The value of the med
49、iaTimeUnit attribute on the closest parent TemporalDecomposition or SpatiotemporalDecomposition element applies. If the attribute is not present on any of the parent TemporalDecomposition or SpatiotemporalDecomposition elements, the value of the mediaTimeUnit attribute of the root a/v segment shall be used. mediaTimeBase attribute excluded The value of the mediaTimeBase attribute on the closest parent TemporalDecompo
