ISO 24613-2008 Language resource management - Lexical markup framework (LMF)《语言资源管理 词汇标记结构(LMF)》.pdf

1、 Reference number ISO 24613:2008(E) ISO 2008INTERNATIONAL STANDARD ISO 24613 First edition 2008-11-15 Language resource management Lexical markup framework (LMF) Gestion de ressources langagires Cadre de balisage lexical (LMF) ISO 24613:2008(E) PDF disclaimer This PDF file may contain embedded typef

2、aces. In accordance with Adobes licensing policy, this file may be printed or viewed but shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading this file, parties accept therein the responsibility of not infrin

3、ging Adobes licensing policy. The ISO Central Secretariat accepts no liability in this area. Adobe is a trademark of Adobe Systems Incorporated. Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation parameters were optim

4、ized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below. COPYRIGHT PROTECTED DOCUMENT ISO 2008 All rights reserved. Un

5、less otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISOs member body in the country of the requester. ISO

6、 copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.org Published in Switzerland ii ISO 2008 All rights reservedISO 24613:2008(E) ISO 2008 All rights reserved iii Contents Page Foreword iv Introduction v 1 Scope . 1 2 N

7、ormative references . 1 3 Terms and definitions. 1 4 Key standards used by LMF 6 4.1 Unicode 6 4.2 Language coding 6 4.3 Script Coding 7 4.4 ISO 12620 Data Category Registry (DCR) 7 4.5 Unified Modeling Language (UML) 7 5 The LMF model 7 5.1 Introduction . 7 5.2 LMF core package. 7 5.3 LMF extension

8、 use 10 5.4 LMF data category selection procedures. 11 5.5 LMF process 12 Annex A (normative) Morphology extension. 13 Annex B (informative) Morphology examples . 15 Annex C (normative) Machine readable dictionary extension. 21 Annex D (informative) Machine readable dictionary examples . 23 Annex E

9、(normative) NLP syntax extension 24 Annex F (informative) NLP syntax examples. 26 Annex G (normative) NLP semantics extension . 29 Annex H (informative) NLP semantic examples 32 Annex I (normative) NLP multilingual notations extension. 39 Annex J (informative) NLP multilingual notations examples. 42

10、 Annex K (normative) NLP morphological patterns extension. 45 Annex L (informative) NLP morphological patterns examples 49 Annex M (normative) NLP multiword expression patterns extension (MWE) 63 Annex N (informative) NLP multiword expression patterns example. 65 Annex O (normative) Constraint expre

11、ssion extension. 67 Annex P (informative) Constraint expression example 69 Annex Q (informative) Connection with terminological markup framework (TMF) and other concept-based representation systems. 71 Annex R (informative) LMF DTD . 72 Bibliography . 76 ISO 24613:2008(E) iv ISO 2008 All rights rese

12、rvedForeword ISO (the International Organization for Standardization) is a worldwide federation of national standards bodies (ISO member bodies). The work of preparing International Standards is normally carried out through ISO technical committees. Each member body interested in a subject for which

13、 a technical committee has been established has the right to be represented on that committee. International organizations, governmental and non-governmental, in liaison with ISO, also take part in the work. ISO collaborates closely with the International Electrotechnical Commission (IEC) on all mat

14、ters of electrotechnical standardization. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2. The main task of technical committees is to prepare International Standards. Draft International Standards adopted by the technical committees are circu

15、lated to the member bodies for voting. Publication as an International Standard requires approval by at least 75 % of the member bodies casting a vote. Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO shall not be held responsi

16、ble for identifying any or all such patent rights. ISO 24613 was prepared by Technical Committee ISO/TC 37, Terminology and other language and content resources, Subcommittee SC 4, Language resource management. ISO 24613 is designed to coordinate closely with ISO 12620, Terminology and other content

17、 and language resources Data categories Specification of data categories and management of a Data Category Registry for language resources 1) , and ISO 16642, Computer applications in terminology Terminological markup framework. 1) To be published. (Revision of ISO 12620:1999) ISO 24613:2008(E) ISO

18、2008 All rights reserved v Introduction Optimizing the production, maintenance and extension of electronic lexical resources is one of the crucial aspects impacting human language technologies (HLT) in general and natural language processing (NLP) in particular, as well as human-oriented translation

19、 technologies. A second crucial aspect involves optimizing the process leading to their integration in applications. Lexical Markup Framework (LMF) is an abstract metamodel that provides a common, standardized framework for the construction of computational lexicons. LMF ensures the encoding of ling

20、uistic information in a way that enables reusability in different applications and for different tasks. LMF provides a common, shared representation of lexical objects, including morphological, syntactic and semantic aspects. The goals of LMF are to provide a common model for the creation and use of

21、 electronic lexical resources ranging from small to large in scale, to manage the exchange of data between and among these resources, and to facilitate the merging of large numbers of different individual electronic resources to form extensive global electronic resources. The ultimate goal of LMF is

22、 to create a modular structure that will facilitate true content interoperability across all aspects of electronic lexical resources. The LMF core package describes the basic hierarchy of information of a lexical entry, including information on the form. The core package is supplemented by various r

23、esources that are part of the definition of LMF. These resources include: specific data categories used by the variety of resource types associated with LMF, both those data categories relevant to the metamodel itself, and those associated with the extensions to the core package; the constraints gov

24、erning the relationship of these data categories to the metamodel and to its extensions; standard procedures for expressing these categories and thus for anchoring them on the structural skeleton of LMF and relating them to the respective extension models; the vocabularies used by LMF to express rel

25、ated informational objects for describing how to extend LMF through linkage to a variety of specific resources (extensions) and methods for analysing and designing such linked systems. Extensions of the core package which are documented in the annexes of this International Standard include: a) machi

26、ne readable dictionaries; b) natural language processing lexical resources. LMF extensions are expressed in a framework that describes the reuse of the LMF core components (such as structures, data categories, and vocabularies) in conjunction with the additional components required for a specific re

27、source. Types of individual instantiations of LMF can include such electronic lexical resources as fairly simple lexical databases, NLP and machine-translation lexicons, as well as electronic monolingual, bilingual and multilingual lexical databases. LMF provides general structures and mechanisms fo

28、r analysing and designing new electronic lexical resources, but LMF does not specify the structures, data constraints and vocabularies to be used in the design of specific electronic lexical resources. LMF also provides mechanisms for analysing and describing existing resources using a common descri

29、ptive framework. For the purpose of both designing new lexical resources and describing existing lexical resources, LMF defines the conditions that allow the data expressed in any one lexical resource to be mapped to the LMF framework, and thus provides an intermediate format for lexical data exchan

30、ge. INTERNATIONAL STANDARD ISO 24613:2008(E) ISO 2008 All rights reserved 1 Language resource management Lexical markup framework (LMF) 1 Scope This International Standard describes the Lexical Markup Framework (LMF), a metamodel for representing data in lexical databases used with monolingual and m

31、ultilingual computer applications. LMF provides mechanisms that allow the development and integration of a variety of electronic lexical resource types 2) . These mechanisms will present existing lexicons as far as possible. If this is impossible, problematic information will be identified and isola

32、ted. 2 Normative references The following referenced documents are indispensable for the application of this document. For dated references, only the edition cited applies. For undated references, the latest edition of the referenced document (including any amendments) applies. ISO 639 (all parts),

33、Codes for the representation of names of languages ISO 1087-1, Terminology work Vocabulary Part 1: Theory and application ISO 1087-2, Terminology work Vocabulary Part 2: Computer applications ISO 12620, Terminology and other content and language resources Data categories Specification of data catego

34、ries and management of a Data Category Registry for language resources 3)ISO 15924, Information and documentation Code for the representation of names of scripts 3 Terms and definitions For the purposes of this International Standard, the terms and definitions given in ISO 1087-1, ISO 1087-2 and the

35、 following apply 4) . 3.1 abbreviated form form (3.14) resulting from the omission of any part of the full form (3.16) of the same lexeme (3.25) 2) LMF supports existing lexical resource models such as the Genelex 9 , the EAGLES International Standards for Language Engineering (ISLE) 5and Multilingu

36、al ISLE Lexical Entry (MILE) models6 . 3) To be published. (Revision of ISO 12620:1999) 4) It is worth noting that we have purposely avoided defining and using highly controversial terms such as “word”, “morpheme”, “base”, “fusion”, “ergative”, “paradigm”, and “collocation”. ISO 24613:2008(E) 2 ISO

37、2008 All rights reserved3.2 adjunct non-essential element associated with a verb as opposed to syntactic arguments (3.43) EXAMPLE Alfred (syntactic argument) reads a book (syntactic argument) today (adjunct). NOTE Adverbs are possible adjuncts for a sentence. 3.3 affix bound morph (3.8) that may con

38、tribute to a form (3.14) and participates in the process of inflection (3.20), agglutination (3.5), derivation (3.12) or composition (3.9) NOTE Affixes function as prefixes (pre-positioned), suffixes (post-positioned), infixes (inserted) and circumfixes (combination of prefix and suffix). 3.4 affixa

39、tion process in which an affix (3.3) is added to a lemma (3.24) or a stem (3.40) 3.5 agglutination process in which an agglutinated form (3.6) is made up 3.6 agglutinated form word form (3.47) that a lexeme (3.25) can take when used in a sentence or a phrase within an agglutinating language (3.7) 3.

40、7 agglutinating language language where the different word forms (3.47) of the same lexeme (3.25) exhibit a variation and that may consist of more than one morph (3.31) but the boundaries between morphs are always clear-cut EXAMPLE Korean, Japanese, Hungarian and Turkish are agglutinating languages

41、16 . 3.8 bound morph morph that appears only together with one or several other morphs (3.31) 3.9 composition compounding lexeme (3.25) formation in which a new lexeme associated with its part of speech (3.37) information is formed by adjoining at least two lexemes, in their original forms (3.14) or

42、 with slight transformations NOTE Composition should not be confused with agglutination and derivation, where bound morphs are added to free ones. 3.10 compound lexeme (3.25) associated with part of speech (3.37) information that is built from two or more lexemes 3.11 compound form form (3.14) resul

43、ting from a composition (3.9) ISO 24613:2008(E) ISO 2008 All rights reserved 3 3.12 derivation change in the forms (3.14) of a lexeme (3.25) to create a new lexeme, usually by modifying the stem (3.40) or by affixation (3.4) NOTE Sometimes derivation signals a change in part of speech, such as natio

44、n to nationalize. Sometimes the part of speech remains the same as in nationalization vs. denationalization. 3.13 derived form form (3.14) resulting from a derivation (3.12) 3.14 form sequence of morphs (3.31) 3.15 free morph morph (3.31) that may stand by itself EXAMPLE The English noun boy. 3.16 f

45、ull form complete representation of a lexeme (3.25) for which there is an abbreviated form (3.6) 3.17 grammatical feature property associated to the inflected (3.19), agglutinated (3.6), compound (3.11) or derived form (3.13) that describes the grammatical attribute of the form NOTE An example of a

46、grammatical feature is: /grammatical gender/. (Following the convention adopted in the revision of ISO 12620, the slashes are used in order to delimit data category values.) 3.18 graph minimal unit in a written language including letters, pictograms, ideograms, numerals and punctuations 3.19 inflect

47、ed form word form (3.47) that a lexeme (3.25) can take when used in a sentence or a phrase within an inflectional language (3.21) 3.20 inflection process in which an inflected form (3.19) is made up 3.21 inflectional language inflecting language language where the different word forms (3.47) of the

48、same lexeme (3.25) exhibit a variation and where there is no clear-cut boundary between morphs (3.31) in that morphs are generally fused together to yield a single, non-segmentable form (3.14) EXAMPLE Spanish, Italian, French and English are inflectional languages16 . 3.22 interlingua abstract inter

49、mediary language used in the machine translation of human languages ISO 24613:2008(E) 4 ISO 2008 All rights reserved3.23 isolating language language where the vast majority of morphs (3.31) are free morphs (3.15) EXAMPLE Chinese is an isolating language. 3.24 lemma lemmatized form canonical form conventional form (3.14) chosen to represent a lexeme (3.25) EXAMPLE In European languages, the lemma is usually the /singular/ if there is a variation in /number/, the /masculine/ form if there is a variation in /g