CAN CSA-ISO IEC 15938-4-2004 Information technology - Multimedia content description interface - Part 4 Audio.pdf

1、 Reference numberISO/IEC 15938-4:2002(E)ISO/IEC 2002Information technology Multimedia content description interface Part 4: Audio Technologies de linformation Interface de description du contenu multimdia Partie 4: Audio National Standard of CanadaCAN/CSA-ISO/IEC 15938-4:04(ISO/IEC 15938-4:2002)Inte

2、rnational Standard ISO/IEC 15938-4:2002 (first edition, 2002-06-15) has been adopted without modification(IDT) as CSA Standard CAN/CSA-ISO/IEC 15938-4:04, which has been approved as a National Standard of Canadaby the Standards Council of Canada.ISBN 1-55397-312-7 January 2004The Canadian Standards

3、Association (CSA), The Standards Council of Canada is theunder whose auspices this National Standard has been coordinating body of the National Standards system, produced, was chartered in 1919 and accredited by a federation of independent, autonomousthe Standards Council of Canada to the National o

4、rganizations working towards the furtherStandards system in 1973. It is a not-for-profit, development and improvement of voluntarynonstatutory, voluntary membership association standardization in the national interest.engaged in standards development and certification The principal objects of the Co

5、uncil are to foster activities. and promote voluntary standardization as a means CSA standards reflect a national consensus of of advancing the national economy, benefiting theproducers and users including manufacturers, health, safety, and welfare of the public, assisting consumers, retailers, unio

6、ns and professional and protecting the consumer, facilitating domestic organizations, and governmental agencies. The and international trade, and furthering internationalstandards are used widely by industry and commerce cooperation in the field of standards.and often adopted by municipal, provincia

7、l, and A National Standard of Canada is a standard whichfederal governments in their regulations, particularly in has been approved by the Standards Council ofthe fields of health, safety, building and construction, Canada and one which reflects a reasonableand the environment. agreement among the v

8、iews of a number of capableIndividuals, companies, and associations across individuals whose collective interests provide to theCanada indicate their support for CSAs standards greatest practicable extent a balance ofdevelopment by volunteering their time and skills to representation of producers, u

9、sers, consumers, andCSA Committee work and supporting the Associations others with relevant interests, as may be appropriateobjectives through sustaining memberships. The more to the subject in hand. It normally is a standardthan 7000 committee volunteers and the 2000 which is capable of making a si

10、gnificant and timelysustaining memberships together form CSAs total contribution to the national interest.membership from which its Directors are chosen. Approval of a standard as a National Standard ofSustaining memberships represent a major source of Canada indicates that a standard conforms to th

11、eincome for CSAs standards development activities. criteria and procedures established by the StandardsThe Association offers certification and testing Council of Canada. Approval does not refer to theservices in support of and as an extension to its technical content of the standard; this remains t

12、hestandards development activities. To ensure the continuing responsibility of the accreditedintegrity of its certification process, the Association standards-development organization.regularly and continually audits and inspects products Those who have a need to apply standards arethat bear the CSA

13、 Mark. encouraged to use National Standards of CanadaIn addition to its head office and laboratory complex whenever practicable. These standards are subject in Toronto, CSA has regional branch offices in major to periodic review; therefore, users are cautioned centres across Canada and inspection an

14、d testing to obtain the latest edition from the organizationagencies in eight countries. Since 1919, the preparing the standard.Association has developed the necessary expertise to The responsibility for approving National Standards meet its corporate mission: CSA is an independent of Canada rests w

15、ith theservice organization whose mission is to provide an Standards Council of Canadaopen and effective forum for activities facilitating the 270 Albert Street, Suite 200exchange of goods and services through the use of Ottawa, Ontario, K1P 6N7standards, certification and related services to meet C

16、anadanational and international needs.For further information on CSA services, write toCanadian Standards Association5060 Spectrum Way, Suite 100Mississauga, Ontario, L4W 5N6CanadaAlthough the intended primary application of this Standard is stated in its Scope, it is importantto note that it remain

17、s the responsibility of the users to judge its suitability for their particular purpose.Registered trade-mark of Canadian Standards AssociationCAN/CSA-ISO/IEC 15938-4:04 description interface Part 4: AudioInformation technology Multimedia contentJanuary 2004 Canadian Standards Association CSA/1CAN/C

18、SA-ISO/IEC 15938-4:04Information technology Multimedia content descriptioninterface Part 3: AudioCSA PrefaceStandards development within the Information Technology sector is harmonized with internationalstandards development. Through the CSA Technical Committee on Information Technology (TCIT),Canad

19、ians serve as the Canadian Advisory Committee (CAC) on ISO/IEC Joint Technical Committee 1 onInformation Technology (ISO/IEC JTC1) for the Standards Council of Canada (SCC), the ISO memberbody for Canada and sponsor of the Canadian National Committee of the IEC. Also, as a member of theInternational

20、 Telecommunication Union (ITU), Canada participates in the International Telegraph andTelephone Consultative Committee (ITU-T).This International Standard was reviewed by the CSA TCIT under the jurisdiction of the StrategicSteering Committee on Information Technology and deemed acceptable for use in

21、 Canada. (Acommittee membership list is available on request from the CSA Project Manager.) From time to time,ISO/IEC may publish addenda, corrigenda, etc. The CSA TCIT will review these documents for approvaland publication. For a listing, refer to the CSA Information Products catalogue or CSA Info

22、 Update orcontact a CSA Sales representative. This Standard has been formally approved, without modification, bythe Technical Committee and has been approved as a National Standard of Canada by the StandardsCouncil of Canada.January 2004 Canadian Standards Association 2004All rights reserved. No par

23、t of this publication may be reproduced in any form whatsoever without the prior permission ofthe publisher. ISO/IEC material is reprinted with permission. Where the words “this International Standard” appear in thetext, they should be interpreted as “this National Standard of Canada”.Inquiries rega

24、rding this National Standard of Canada should be addressed to Canadian Standards Association 5060 Spectrum Way, Suite 100, Mississauga, Ontario, Canada L4W 5N6 1-800-463-6727 416-747-4044www.csa.caReference numberISO/IEC 15938-4:2002(E)ISO/IEC 2002INTERNATIONAL STANDARD ISO/IEC15938-4First edition20

25、02-06-15Information technology Multimedia content description interface Part 4: Audio Technologies de linformation Interface de description du contenu multimdia Partie 4: Audio ISO/IEC 15938-4:2002(E) PDF disclaimer This PDF file may contain embedded typefaces. In accordance with Adobes licensing po

26、licy, this file may be printed or viewed but shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading this file, parties accept therein the responsibility of not infringing Adobes licensing policy. The ISO Centra

27、l Secretariat accepts no liability in this area. Adobe is a trademark of Adobe Systems Incorporated. Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation parameters were optimized for printing. Every care has been taken

28、 to ensure that the file is suitable for use by ISO member bodies. In the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below. ISO/IEC 2002 All rights reserved. Unless otherwise specified, no part of this publication may be reproduc

29、ed or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749

30、01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.ch Web www.iso.ch ii ISO/IEC 2002 All rights reservedISO/IEC 15938-4:2002(E) ISO/IEC 2002 All rights reserved iiiContents Page Forewordv Introductionvi 1 Scope 1 1.1 Definition of Scope 1 1.2 Fields of application 1 2 Terms and definitions .2 3 Symbols

31、 and abbreviated terms 2 4 Conventions .3 4.1 Description Definition Language .3 4.2 Audio representation.3 5 Audio Framework 4 5.1 Introduction4 5.2 Scalable Series 4 5.2.1 Introduction4 5.2.2 ScalableSeriesType .5 5.2.3 SeriesOfScalarType.6 5.2.4 SeriesOfScalarBinaryType9 5.2.5 SeriesOfVectorType

32、10 5.2.6 SeriesOfVectorBinaryType .13 5.3 Low level Audio Descriptors 13 5.3.1 Introduction13 5.3.2 AudioLLDScalarType 14 5.3.3 AudioLLDVectorType 15 5.3.4 AudioWaveformType.16 5.3.5 AudioPowerType .17 5.3.6 Audio Spectrum Descriptors17 5.3.7 AudioSpectrumEnvelopeType18 5.3.8 AudioSpectrumCentroidTy

33、pe.21 5.3.9 AudioSpectrumSpreadType .23 5.3.10 AudioSpectrumFlatnessType.24 5.3.11 AudioSpectrumBasisType26 5.3.12 AudioSpectrumProjectionType29 5.3.13 AudioHarmonicityType .33 5.3.14 Timbre Descriptors36 5.3.15 LogAttackTimeType 38 5.3.16 HarmonicSpectralCentroidType.39 5.3.17 HarmonicSpectralDevia

34、tionType .41 5.3.18 HarmonicSpectralSpreadType .42 5.3.19 HarmonicSpectralVariationType 44 5.3.20 SpectralCentroidType .45 5.3.21 TemporalCentroidType .46 5.4 Silence 46 5.4.1 Introduction46 5.4.2 SilenceHeaderType47 5.4.3 SilenceType47 5.4.4 Usage, examples and extraction (informative).48 6 High Le

35、vel Tools 49 6.1 Introduction49 6.2 Audio Signature .49 ISO/IEC 15938-4:2002(E) iv ISO/IEC 2002 All rights reserved6.2.1 Introduction 49 6.2.2 AudioSignatureType50 6.2.3 Instantiation requirements50 6.2.4 Usage and examples (informative) 50 6.3 Timbre .51 6.3.1 Introduction 51 6.3.2 InstrumentTimbre

36、Type52 6.3.3 HarmonicInstrumentTimbreType .53 6.3.4 PercussiveInstrumentTimbreType.54 6.3.5 Usage, extraction and examples (informative).55 6.4 General Sound Recognition and Indexing 56 6.4.1 Introduction 56 6.4.2 SoundModelType .57 6.4.3 SoundClassificationModelType .59 6.4.4 SoundModelStatePathTyp

37、e 61 6.4.5 SoundModelStateHistogramType 62 6.4.6 General Sound Classification and Indexing Applications (informative)64 6.5 Spoken Content .66 6.5.1 Introduction 66 6.5.2 SpokenContentHeaderType67 6.5.3 SpeakerInfoType 68 6.5.4 SpokenContentIndexEntryType .71 6.5.5 ConfusionCountType 71 6.5.6 WordTy

38、pe, PhoneType, WordLexiconIndexType and PhoneLexiconIndexType73 6.5.7 LexiconType .74 6.5.8 WordLexiconType74 6.5.9 phoneticAlphabetType 75 6.5.10 PhoneLexiconType 75 6.5.11 SpokenContentLatticeType 76 6.5.12 SpokenContentLinkType.78 6.5.13 Usage, extraction and examples (informative).79 6.6 Melody.

39、84 6.6.1 Introduction 84 6.6.2 MelodyType 84 6.6.3 Meter85 6.6.4 scaleType86 6.6.5 MelodyKey 86 6.6.6 MelodyContourType 88 6.6.7 contourType .88 6.6.8 beatType .89 6.6.9 MelodySequence90 6.6.10 Usage of MelodyContour (informative) .92 6.6.11 Usage of MelodySequence (informative) 94 6.6.12 Examples (

40、informative) .94 Annex A (informative) Usage, extraction and examples of Scalable Series .96 Annex B (informative) Patent statements .105 ISO/IEC 15938-4:2002(E) ISO/IEC 2002 All rights reserved vForeword ISO (the International Organization for Standardization) and IEC (the International Electrotech

41、nical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical ac

42、tivity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO and IEC have established a joint technical com

43、mittee, ISO/IEC JTC 1. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 3. The main task of the joint technical committee is to prepare International Standards. Draft International Standards adopted by the joint technical committee are circulated

44、 to national bodies for voting. Publication as an International Standard requires approval by at least 75 % of the national bodies casting a vote. ISO/IEC 15938-4 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology, Subcommittee SC 29, Coding of audio, picture, multimedia

45、 and hypermedia information. ISO/IEC 15938 consists of the following parts, under the general title Information technology Multimedia content description interface: Part 1: Systems Part 2: Description definition language Part 3: Visual Part 4: Audio Part 5: Multimedia description schemes Part 6: Ref

46、erence software Part 7: Conformance testing Part 8: Extraction and use of MPEG-7 descriptions Annexes A and B of this part of ISO/IEC 15938 are for information only. ISO/IEC 15938-4:2002(E) vi ISO/IEC 2002 All rights reservedIntroduction This standard, also known as “Multimedia Content Description I

47、nterface,“ provides a standardized set of technologies for describing multimedia content. The standard addresses a broad spectrum of multimedia applications and requirements by providing a metadata system for describing the features of multimedia content. The following are specified in this standard

48、: Description Schemes (DS) describe entities or relationships pertaining to multimedia content. Description Schemes specify the structure and semantics of their components, which may be Description Schemes, Descriptors, or datatypes. Descriptors (D) describe features, attributes, or groups of attrib

49、utes of multimedia content. Datatypes are the basic reusable datatypes employed by Description Schemes and Descriptors Description Definition Language (DDL) defines Description Schemes, Descriptors, and Datatypes by specifying their syntax, and allows their extension. Systems tools support delivery of descriptions, multiplexing of descriptions with multimedia content, synchronization, file format, and so forth. This standard is subdivided into eight parts: Part 1 Systems: specifies the tool