1、 Collection of SANS standards in electronic format (PDF) 1. Copyright This standard is available to staff members of companies that have subscribed to the complete collection of SANS standards in accordance with a formal copyright agreement. This document may reside on a CENTRAL FILE SERVER or INTRA
2、NET SYSTEM only. Unless specific permission has been granted, this document MAY NOT be sent or given to staff members from other companies or organizations. Doing so would constitute a VIOLATION of SABS copyright rules. 2. Indemnity The South African Bureau of Standards accepts no liability for any
3、damage whatsoever than may result from the use of this material or the information contain therein, irrespective of the cause and quantum thereof. ISBN 978-0-626-23292-4 SANS 24613:2009Edition 1ISO 24613:2008Edition 1SOUTH AFRICAN NATIONAL STANDARD Language resource management Lexical markup framewo
4、rk (LMF) This national standard is the identical implementation of ISO 24613:2008 and is adopted with the permission of the International Organization for Standardization. Published by SABS Standards Division 1 Dr Lategan Road Groenkloof Private Bag X191 Pretoria 0001 Tel: +27 12 428 7911 Fax: +27 1
5、2 344 1568 www.sabs.co.za SABS SANS 24613:2009 Edition 1 ISO 24613:2008 Edition 1 Table of changes Change No. Date Scope National foreword This South African standard was approved by National Committee SABS TC 37, Terminology and other language and content resources, in accordance with procedures of
6、 the SABS Standards Division, in compliance with annex 3 of the WTO/TBT agreement. This SANS document was published in September 2009. Reference numberISO 24613:2008(E)ISO 2008INTERNATIONAL STANDARD ISO24613First edition2008-11-15Language resource management Lexical markup framework (LMF) Gestion de
7、 ressources langagires Cadre de balisage lexical (LMF) SANS 24613:2009This s tandard may only be used and printed by approved subscription and freemailing clients of the SABS .ISO 24613:2008(E) PDF disclaimer This PDF file may contain embedded typefaces. In accordance with Adobes licensing policy, t
8、his file may be printed or viewed but shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading this file, parties accept therein the responsibility of not infringing Adobes licensing policy. The ISO Central Secre
9、tariat accepts no liability in this area. Adobe is a trademark of Adobe Systems Incorporated. Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation parameters were optimized for printing. Every care has been taken to ens
10、ure that the file is suitable for use by ISO member bodies. In the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below. COPYRIGHT PROTECTED DOCUMENT ISO 2008 All rights reserved. Unless otherwise specified, no part of this publicati
11、on may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Case postale 56 CH-1211 Geneva 20
12、 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.org Published in Switzerland ii ISO 2008 All rights reservedSANS 24613:2009This s tandard may only be used and printed by approved subscription and freemailing clients of the SABS .ISO 24613:2008(E) ISO 2008 All rights
13、 reserved iiiContents Page Foreword iv Introduction v 1 Scope . 1 2 Normative references . 1 3 Terms and definitions. 1 4 Key standards used by LMF 6 4.1 Unicode 6 4.2 Language coding 6 4.3 Script Coding 7 4.4 ISO 12620 Data Category Registry (DCR) 7 4.5 Unified Modeling Language (UML) 7 5 The LMF m
14、odel 7 5.1 Introduction . 7 5.2 LMF core package. 7 5.3 LMF extension use 10 5.4 LMF data category selection procedures. 11 5.5 LMF process 12 Annex A (normative) Morphology extension. 13 Annex B (informative) Morphology examples . 15 Annex C (normative) Machine readable dictionary extension. 21 Ann
15、ex D (informative) Machine readable dictionary examples . 23 Annex E (normative) NLP syntax extension 24 Annex F (informative) NLP syntax examples. 26 Annex G (normative) NLP semantics extension . 29 Annex H (informative) NLP semantic examples 32 Annex I (normative) NLP multilingual notations extens
16、ion. 39 Annex J (informative) NLP multilingual notations examples. 42 Annex K (normative) NLP morphological patterns extension. 45 Annex L (informative) NLP morphological patterns examples 49 Annex M (normative) NLP multiword expression patterns extension (MWE) 63 Annex N (informative) NLP multiword
17、 expression patterns example. 65 Annex O (normative) Constraint expression extension. 67 Annex P (informative) Constraint expression example 69 Annex Q (informative) Connection with terminological markup framework (TMF) and other concept-based representation systems. 71 Annex R (informative) LMF DTD
18、 . 72 Bibliography . 76 SANS 24613:2009This s tandard may only be used and printed by approved subscription and freemailing clients of the SABS .ISO 24613:2008(E) iv ISO 2008 All rights reservedForeword ISO (the International Organization for Standardization) is a worldwide federation of national st
19、andards bodies (ISO member bodies). The work of preparing International Standards is normally carried out through ISO technical committees. Each member body interested in a subject for which a technical committee has been established has the right to be represented on that committee. International o
20、rganizations, governmental and non-governmental, in liaison with ISO, also take part in the work. ISO collaborates closely with the International Electrotechnical Commission (IEC) on all matters of electrotechnical standardization. International Standards are drafted in accordance with the rules giv
21、en in the ISO/IEC Directives, Part 2. The main task of technical committees is to prepare International Standards. Draft International Standards adopted by the technical committees are circulated to the member bodies for voting. Publication as an International Standard requires approval by at least
22、75 % of the member bodies casting a vote. Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO shall not be held responsible for identifying any or all such patent rights. ISO 24613 was prepared by Technical Committee ISO/TC 37, Te
23、rminology and other language and content resources, Subcommittee SC 4, Language resource management. ISO 24613 is designed to coordinate closely with ISO 12620, Terminology and other content and language resources Data categories Specification of data categories and management of a Data Category Reg
24、istry for language resources1), and ISO 16642, Computer applications in terminology Terminological markup framework. 1) To be published. (Revision of ISO 12620:1999) SANS 24613:2009This s tandard may only be used and printed by approved subscription and freemailing clients of the SABS .ISO 24613:200
25、8(E) ISO 2008 All rights reserved vIntroduction Optimizing the production, maintenance and extension of electronic lexical resources is one of the crucial aspects impacting human language technologies (HLT) in general and natural language processing (NLP) in particular, as well as human-oriented tra
26、nslation technologies. A second crucial aspect involves optimizing the process leading to their integration in applications. Lexical Markup Framework (LMF) is an abstract metamodel that provides a common, standardized framework for the construction of computational lexicons. LMF ensures the encoding
27、 of linguistic information in a way that enables reusability in different applications and for different tasks. LMF provides a common, shared representation of lexical objects, including morphological, syntactic and semantic aspects. The goals of LMF are to provide a common model for the creation an
28、d use of electronic lexical resources ranging from small to large in scale, to manage the exchange of data between and among these resources, and to facilitate the merging of large numbers of different individual electronic resources to form extensive global electronic resources. The ultimate goal o
29、f LMF is to create a modular structure that will facilitate true content interoperability across all aspects of electronic lexical resources. The LMF core package describes the basic hierarchy of information of a lexical entry, including information on the form. The core package is supplemented by v
30、arious resources that are part of the definition of LMF. These resources include: specific data categories used by the variety of resource types associated with LMF, both those data categories relevant to the metamodel itself, and those associated with the extensions to the core package; the constra
31、ints governing the relationship of these data categories to the metamodel and to its extensions; standard procedures for expressing these categories and thus for anchoring them on the structural skeleton of LMF and relating them to the respective extension models; the vocabularies used by LMF to exp
32、ress related informational objects for describing how to extend LMF through linkage to a variety of specific resources (extensions) and methods for analysing and designing such linked systems. Extensions of the core package which are documented in the annexes of this International Standard include:
33、a) machine readable dictionaries; b) natural language processing lexical resources. LMF extensions are expressed in a framework that describes the reuse of the LMF core components (such as structures, data categories, and vocabularies) in conjunction with the additional components required for a spe
34、cific resource. Types of individual instantiations of LMF can include such electronic lexical resources as fairly simple lexical databases, NLP and machine-translation lexicons, as well as electronic monolingual, bilingual and multilingual lexical databases. LMF provides general structures and mecha
35、nisms for analysing and designing new electronic lexical resources, but LMF does not specify the structures, data constraints and vocabularies to be used in the design of specific electronic lexical resources. LMF also provides mechanisms for analysing and describing existing resources using a commo
36、n descriptive framework. For the purpose of both designing new lexical resources and describing existing lexical resources, LMF defines the conditions that allow the data expressed in any one lexical resource to be mapped to the LMF framework, and thus provides an intermediate format for lexical dat
37、a exchange. SANS 24613:2009This s tandard may only be used and printed by approved subscription and freemailing clients of the SABS .SANS 24613:2009This s tandard may only be used and printed by approved subscription and freemailing clients of the SABS .INTERNATIONAL STANDARD ISO 24613:2008(E) ISO 2
38、008 All rights reserved 1Language resource management Lexical markup framework (LMF) 1 Scope This International Standard describes the Lexical Markup Framework (LMF), a metamodel for representing data in lexical databases used with monolingual and multilingual computer applications. LMF provides mec
39、hanisms that allow the development and integration of a variety of electronic lexical resource types2). These mechanisms will present existing lexicons as far as possible. If this is impossible, problematic information will be identified and isolated. 2 Normative references The following referenced
40、documents are indispensable for the application of this document. For dated references, only the edition cited applies. For undated references, the latest edition of the referenced document (including any amendments) applies. ISO 639 (all parts), Codes for the representation of names of languages IS
41、O 1087-1, Terminology work Vocabulary Part 1: Theory and application ISO 1087-2, Terminology work Vocabulary Part 2: Computer applications ISO 12620, Terminology and other content and language resources Data categories Specification of data categories and management of a Data Category Registry for l
42、anguage resources 3)ISO 15924, Information and documentation Code for the representation of names of scripts 3 Terms and definitions For the purposes of this International Standard, the terms and definitions given in ISO 1087-1, ISO 1087-2 and the following apply 4). 3.1 abbreviated form form (3.14)
43、 resulting from the omission of any part of the full form (3.16) of the same lexeme (3.25) 2) LMF supports existing lexical resource models such as the Genelex 9, the EAGLES International Standards for Language Engineering (ISLE) 5and Multilingual ISLE Lexical Entry (MILE) models6. 3) To be publishe
44、d. (Revision of ISO 12620:1999) 4) It is worth noting that we have purposely avoided defining and using highly controversial terms such as “word”, “morpheme”, “base”, “fusion”, “ergative”, “paradigm”, and “collocation”. SANS 24613:2009This s tandard may only be used and printed by approved subscript
45、ion and freemailing clients of the SABS .ISO 24613:2008(E) 2 ISO 2008 All rights reserved3.2 adjunct non-essential element associated with a verb as opposed to syntactic arguments (3.43) EXAMPLE Alfred (syntactic argument) reads a book (syntactic argument) today (adjunct). NOTE Adverbs are possible
46、adjuncts for a sentence. 3.3 affix bound morph (3.8) that may contribute to a form (3.14) and participates in the process of inflection (3.20), agglutination (3.5), derivation (3.12) or composition (3.9) NOTE Affixes function as prefixes (pre-positioned), suffixes (post-positioned), infixes (inserte
47、d) and circumfixes (combination of prefix and suffix). 3.4 affixation process in which an affix (3.3) is added to a lemma (3.24) or a stem (3.40) 3.5 agglutination process in which an agglutinated form (3.6) is made up 3.6 agglutinated form word form (3.47) that a lexeme (3.25) can take when used in
48、 a sentence or a phrase within an agglutinating language (3.7) 3.7 agglutinating language language where the different word forms (3.47) of the same lexeme (3.25) exhibit a variation and that may consist of more than one morph (3.31) but the boundaries between morphs are always clear-cut EXAMPLE Kor
49、ean, Japanese, Hungarian and Turkish are agglutinating languages 16. 3.8 bound morph morph that appears only together with one or several other morphs (3.31) 3.9 composition compounding lexeme (3.25) formation in which a new lexeme associated with its part of speech (3.37) information is formed by adjoining at least two lexemes, in their original forms (3.14) or with slight transformations NOTE Composition should not be confused with agglutination and derivation, where bound morphs are added to free ones. 3.10 c
