CAN CSA-ISO IEC 14496-5P-2009 Information technology Coding of audio-visual objects Part 5 Reference software AMENDMENT 16 Symbolic Music Representation reference software.pdf

1、Information technology Coding of audio-visual objects Part 5: Reference software AMENDMENT 16: Symbolic Music Representation reference softwareAmendment 16:2009 (IDT) toNational Standard of CanadaCAN/CSA-ISO/IEC 14496-5-06(ISO/IEC 14496-5:2001, IDT)NOT FOR RESALE.PUBLICATION NON DESTINE LA REVENTE.C

2、SA Standards Update ServiceAmendment 16:2009 toCAN/CSA-ISO/IEC 14496-5-06October 2009Title: Information technology Coding of audio-visual objects Part 5: Reference software AMENDMENT 16: Symbolic Music Representation reference softwarePagination: 12 pages (iii preliminary and 9 text)To register for

3、e-mail notification about any updates to this publicationgo to www.ShopCSA.caclick on E-mail Services under MY ACCOUNTclick on CSA Standards Update ServiceThe List ID that you will need to register for updates to this publication is 2418153.If you require assistance, please e-mail techsupportcsa.ca

4、or call 416-747-2233.Visit CSAs policy on privacy at www.csagroup.org/legal to find out how we protect your personal information.Reference numberISO/IEC 14496-5:2001/Amd.16:2008(E)ISO/IEC 2008INTERNATIONAL STANDARD ISO/IEC14496-5Second edition2001-12-15AMENDMENT 162008-07-15Information technology Co

5、ding of audio-visual objects Part 5: Reference software AMENDMENT 16: Symbolic Music Representation reference software Technologies de linformation Codage des objets audiovisuels Partie 5: Logiciel de rfrence AMENDEMENT 16: Logiciel de rfrence pour la reprsentation musicale symbolique ISO/IEC 14496-

6、5:2001/Amd.16:2008(E) PDF disclaimer This PDF file may contain embedded typefaces. In accordance with Adobes licensing policy, this file may be printed or viewed but shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In d

7、ownloading this file, parties accept therein the responsibility of not infringing Adobes licensing policy. The ISO Central Secretariat accepts no liability in this area. Adobe is a trademark of Adobe Systems Incorporated. Details of the software products used to create this PDF file can be found in

8、the General Info relative to the file; the PDF-creation parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the addre

9、ss given below. COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2008 All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from either

10、ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.org ii ISO/IEC 2008 All rights reservedAmendment 16:2009 toCAN/CSA-ISO/IEC 14496-5-06I

11、SO/IEC 14496-5:2001/Amd.16:2008(E) ISO/IEC 2008 All rights reserved iiiForeword ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC p

12、articipate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governm

13、ental and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part

14、 2. The main task of the joint technical committee is to prepare International Standards. Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as an International Standard requires approval by at least 75 % of the national b

15、odies casting a vote. Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. Amendment 16 to ISO/IEC 14496-5:2001 was prepared by Joint Technical Co

16、mmittee ISO/IEC JTC 1, Information technology, Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information. This Amendment adds the Reference Software of Symbolic Music Representation as defined in ISO/IEC 14496-23 and ISO/IEC 14496-11:2005/Amd.5. There are two parts to the S

17、MR reference software reference software MPEG-4 Systems dependent and MPEG-4 Systems independent parts. The MPEG-4 Systems dependent part is implemented and made available as a revision to the IM1 reference software for MPEG-4 Systems. The MPEG-4 Systems independent part is available as an independe

18、nt implementation. Amendment 16:2009 toCAN/CSA-ISO/IEC 14496-5-06ISO/IEC 14496-5:2001/Amd.16:2008(E) ISO/IEC 2008 All rights reserved 1Information technology Coding of audio-visual objects Part 5: Reference software AMENDMENT 16: Symbolic Music Representation reference software In Clause 3: “Audio r

19、eference software“, add a row to the table: audio/SNHC/mpeg4smr Symbolic Music Representation decoder and tools In Clause 5: “Systems reference software“, add a row to the table: systems/IM1-SMR IM1 supporting SMR nodes Add Annex D: “Guidance on SMR reference software“ and rename Annexes D and E as

20、Annexes E and F respectively. Annex D (informative) Guidance on SMR reference software D.1 IM1 Reference Software update In Systems/IM1-SMR directory the IM1 project has been enhanced to provide support for SMR, in more details: the Nodes.cpp, Nodes.h file has been updated to support the two new nod

21、es (MusicScore and ScoreShape); the new MusicScoreProxy and ScoreShapeProxy classes have been created; the new SMRDecoder project to build the decoder dll has been created, it provides the interface needed for the integration with IM1, it uses the SMRDecoderLib to process the SMR bitstream, to gener

22、ate a bitmap representing the score and it is used also to manipulate the SMR content itself. The MP4Enc application has been enhanced to allow the encoding in MP4 files of SMR information together with the BIFS scene description. Amendment 16:2009 toCAN/CSA-ISO/IEC 14496-5-06ISO/IEC 14496-5:2001/Am

23、d.16:2008(E) 2 ISO/IEC 2008 All rights reservedFigure D.1 Structure of IM1 with SMR In Figure D.2 a UML diagram describes the relations of the new classes with the IM1 existing classes. The ScoreShape and MusicScore classes represent the data model, they has as attributes the fields defined in the n

24、odes specification. The MusicScore class is derived from the StreamConsumer class since it has to present the data coming from SMR decoder. The ScoreShapeProxy and the MusicScoreProxy are used to render the nodes in the multimedia scene. The MusicScoreProxy class uses the SMRDecoder object to intera

25、ct with the Partitura object that contains the music score coming from the SMR stream. The SMRDecoder class derived from the DecoderImp class implements the interface to decode data coming from the SMR stream. The real decoding work is performed by the SMRInternalDecoder class that is a faade class

26、defined in the strictly SMR related software that hides the interaction the SMR data structures (this was done to avoid to add to IM1 the dependency to SMR). Figure D.2 UML diagram of new classes In Figure D.3 a snapshot of IM1 using MusicScore node is presented. IM1 SMRDecoder SMRDecoderLib MusicSc

27、oreProxyOther Decoders Amendment 16:2009 toCAN/CSA-ISO/IEC 14496-5-06ISO/IEC 14496-5:2001/Amd.16:2008(E) ISO/IEC 2008 All rights reserved 3Figure D.3 IM1 with SMR D.2 SMR source code D.2.1 Source files organization In audio/SNHC/mpeg4smr is present the source code needed to build an SMR decoder to b

28、e used in IM1, a SMR viewer application and a SMR editor application. Location Content errmsg contains error messages used at runtime errmsg/xsd contains XML schemas used for validation font contains fonts, font tables and the SMFL rules file (smfl.xml) used for rendering the score lib contains the

29、produced SMR library samples contains the source code for a music editor (wmusiceditor) and for a score viewer (wmusicviewer) using the SMR library (open the smr.dsw file with MS Visual Studio 6.0) smrdecoderlib contains the source code to implement the SMRDecoderLib used in IM1, it is built on top

30、of the smr library source contains the source code used to build the SMR library, open the smr.dsw with MS Visual Studio 6.0 to build the library source/abb contains classes for ornaments (from italian abbellimenti) source/alt contains classes for accidentals (from italian alterazioni) Amendment 16:

31、2009 toCAN/CSA-ISO/IEC 14496-5-06ISO/IEC 14496-5:2001/Amd.16:2008(E) 4 ISO/IEC 2008 All rights reservedsource/aud contains interface classes to link with an audio player source/bat contains classes for measure representation (from italian battuta) source/bit contains classes for SMR bitstream manage

32、ment source/bitmaps contains bitmaps resources source/bra contains classes for brackets connecting scores in the main score source/drw contains classes for basic drawing source/fig contains classes for musical figures representation (notes, rests, chords, beams) source/fon contains classes for font

33、management source/gui contains classes for high level gui source/img contains classes for image management source/imp contains classes for MIDI import source/ind contains classes for indication symbols (expression symbols, fingering, mute, accents, etc.) source/int contains classes for horizontal sy

34、mbols or interval symbols like slurs, crescendo, diminuendo etc. source/kor contains classes for Korean ornaments source/lst contains a class to manage lists source/lyr contains classes for lyric management source/mdo contains classes for MIDI production source/mil contains classes for SMFL rules in

35、terpretation source/net contains classes for network access source/pag contains classes for page objects (textbox, imagebox) source/par contains classes for main score management (from italian partitura) source/sca contains classes for jump symbols, metronome, labels (from italian scansione) source/

36、smr contain classes to manage SMR content source/spa contains classes for single part management (from italian spartito) source/str contains classes for instrumental symbols (from italian strumenti) source/txt contains classes for textual indication source/var contains classes for duration variation

37、 (augmentation dots, corona) source/xml contains classes for xml loading using sax and dom Amendment 16:2009 toCAN/CSA-ISO/IEC 14496-5-06ISO/IEC 14496-5:2001/Amd.16:2008(E) ISO/IEC 2008 All rights reserved 5D.2.2 Building dependencies Other components needed to build the SMR library are: wxWindows v

38、. 2.2.6 (http:/www.wxwindows.org) xerces v. 2.6.0 (http:/xml.apache.org/dist/xerces-c) To build the library and the examples, use MS Visual Studio 6.0 and SET the following environment variables: WXWIN set to the path where the wxWindows home is (i.e. c:wx2-226) XERCES set to the path where the xerc

39、es library is (i.e. c:xerces-2_6_0) D.2.3 Runtime dependencies The SMR Editor, SMR Viewer and SMRDecoderLib need the following registry keys (normally are set by the SMR Editor) HKEY_CURRENT_USERSoftwareSMRpaths errpath contains the errpath directory (important for validation) fontpath contains the

40、font path imgscore not used midipath not used smrpath path where to start searching for SMR files D.2.4 SMR core classes In Figures D.4 and D.5 some of the core classes defined to model the music score are reported Amendment 16:2009 toCAN/CSA-ISO/IEC 14496-5-06ISO/IEC 14496-5:2001/Amd.16:2008(E) 6 I

41、SO/IEC 2008 All rights reservedFigure D.4 Core SMR classes, part 1 Figure D.5 Core SMR classes, part 2 Amendment 16:2009 toCAN/CSA-ISO/IEC 14496-5-06ISO/IEC 14496-5:2001/Amd.16:2008(E) ISO/IEC 2008 All rights reserved 7These classes support: score positioning and drawing (as main score or as a singl

42、e part) the score positioning is performed using the SMFL rules (loaded form file); score editing; load and save as XML; MIDI generation; generation of MP4 files containing the plain XML, gzipped XML or BiM encoded XML; loading from MP4 files; D.3 SMR Music Editor Using the SMR library a simple musi

43、c editor has been implemented, in Figure D.6 the user interface is presented. Figure D.6 SMR Music Editor The main functionalities provided are: create a new score form scratch; load and save from/to the XML format and MP4 files; Amendment 16:2009 toCAN/CSA-ISO/IEC 14496-5-06ISO/IEC 14496-5:2001/Amd

44、.16:2008(E) 8 ISO/IEC 2008 All rights reserved save bitstream for integration in the BIFS scene (using MP4Enc) browse the score; see the score as main score or as single parts (a different window is opened) MIDI execution; score editing; score transposition; score formatting; use and debug of SMFL r

45、ules. D.4 SMR Music Viewer Using the SMR library the SMR Music Viewer has been implemented, in Figure 7 a snapshot is provided. Figure D.7 SMR Music Viewer Amendment 16:2009 toCAN/CSA-ISO/IEC 14496-5-06ISO/IEC 14496-5:2001/Amd.16:2008(E) ISO/IEC 2008 All rights reserved 9The main functionalities pro

46、vided are: load from the XML format and MP4 files; browse the score; see the score as main score or as single parts; MIDI execution; score transposition; In Annex E “Providers of Reference software add: DISIT-DSI University of Florence EXITECH srl Amendment 16:2009 toCAN/CSA-ISO/IEC 14496-5-06ISO/IE

47、C 14496-5:2001/Amd.16:2008(E) ICS 35.040 ISO/IEC 2008 All rights reserved Copyright NoticeThis Amendment to the International Standard contains information copyright protected by the International Organization for Standardization (ISO) and the International Electrotechnical Commission (IEC). Except

48、as permitted under the laws of Canada, no extract of this Amendment to the International Standard may be reproduced, stored in any retrieval system, or transmitted in any form or by any means, electronic, photocopying, recording, or otherwise, without prior permission from the Standards Council of C

49、anada (SCC). Requests for permission to reproduce this Amendment to the International Standard or parts thereof should be addressed to Manager, Technical Document Centre Standards Council of Canada 270 Albert Street, Suite 200 Ottawa, Ontario K1P 6N7 The Canadian adoption of this Amendment to the International Standard contains information copyright protected by the Canadian Standards Association. All rights re