CAN CSA-ISO IEC 13249-2-2004 Information technology Database languages SQL multimedia and application packages Part 2 Full-Text.pdf

1、 Reference numberISO/IEC 13249-2:2003(E)ISO/IEC 2003Information technology Database languages SQL multimedia and application packages Part 2: Full-Text Technologies de linformation Langages de bases de donnes Multimdia SQL et paquetages dapplication Partie 2: Texte complet National Standard of Canad

2、aCAN/CSA-ISO/IEC 13249-2:04(ISO/IEC 13249-2:2003)International Standard ISO/IEC 13249-2:2003 (second edition, 2003-11-01) has been adopted withoutmodification (IDT) as CSA Standard CAN/CSA-ISO/IEC 13249-2:04, which has been approved as a NationalStandard of Canada by the Standards Council of Canada.

3、ISBN 1-55397-809-9 December 2004The Canadian Standards Association (CSA), under whose auspices this National Standard has been produced, was chartered in 1919 and accredited by the Standards Council of Canada to the National Standards system in 1973. It is a not-for-profit, nonstatutory, voluntary m

4、embership association engaged in standards development and certification activities. CSA standards reflect a national consensus of producers and users including manufacturers, consumers, retailers, unions and professional organizations, and governmental agencies. The standards are used widely by ind

5、ustry and commerce and often adopted by municipal, provincial, and federal governments in their regulations, particularly in the fields of health, safety, building and construction, and the environment. Individuals, companies, and associations across Canada indicate their support for CSAs standards

6、development by volunteering their time and skills to CSA Committee work and supporting the Associations objectives through sustaining memberships. The more than 7000 committee volunteers and the 2000 sustaining memberships together form CSAs total membership from which its Directors are chosen. Sust

7、aining memberships represent a major source of income for CSAs standards development activities. The Association offers certification and testing services in support of and as an extension to its standards development activities. To ensure the integrity of its certification process, the Association

8、regularly and continually audits and inspects products that bear the CSA Mark. In addition to its head office and laboratory complex in Toronto, CSA has regional branch offices in major centres across Canada and inspection and testing agencies in eight countries. Since 1919, the Association has deve

9、loped the necessary expertise to meet its corporate mission: CSA is an independent service organization whose mission is to provide an open and effective forum for activities facilitating the exchange of goods and services through the use of standards, certification and related services to meet nati

10、onal and international needs.For further information on CSA services, write toCanadian Standards Association5060 Spectrum Way, Suite 100Mississauga, Ontario, L4W 5N6CanadaThe Standards Council of Canada is the coordinating body of the National Standards system, a federation of independent, autonomou

11、s organizations working towards the further development and improvement of voluntary standardization in the national interest. The principal objects of the Council are to foster and promote voluntary standardization as a means of advancing the national economy, benefiting the health, safety, and wel

12、fare of the public, assisting and protecting the consumer, facilitating domestic and international trade, and furthering international cooperation in the field of standards. A National Standard of Canada is a standard which has been approved by the Standards Council of Canada and one which reflects

13、a reasonable agreement among the views of a number of capable individuals whose collective interests provide to the greatest practicable extent a balance of representation of producers, users, consumers, and others with relevant interests, as may be appropriate to the subject in hand. It normally is

14、 a standard which is capable of making a significant and timely contribution to the national interest. Approval of a standard as a National Standard of Canada indicates that a standard conforms to the criteria and procedures established by the Standards Council of Canada. Approval does not refer to

15、the technical content of the standard; this remains the continuing responsibility of the accredited standards development organization. Those who have a need to apply standards are encouraged to use National Standards of Canada whenever practicable. These standards are subject to periodic review; th

16、erefore, users are cautioned to obtain the latest edition from the organization preparing the standard.The responsibility for approving National Standards of Canada rests with theStandards Council of Canada270 Albert Street, Suite 200Ottawa, Ontario, K1P 6N7CanadaAlthough the intended primary applic

17、ation of this Standard is stated in its Scope, it is importantto note that it remains the responsibility of the users to judge its suitability for their particular purpose.Registered trade-mark of Canadian Standards AssociationCAN/CSA-ISO/IEC 13249-2:04Information technology Database languages SQLmu

18、ltimedia and application packages Part 2: Full-TextDecember 2004 Canadian Standards Association CSA/1CAN/CSA-ISO/IEC 13249-2:04Information technology Database languages SQL multimedia and application packages Part 2: Full-TextCSA PrefaceStandards development within the Information Technology sector

19、is harmonized with international standards development. Through the CSA Technical Committee on Information Technology (TCIT, Canadians serve as the Canadian Advisory Committee (CAC) on ISO/IEC Joint Technical Committee 1 on Information Technology (ISO/IEC JTC1) for the Standards Council of Canada (S

20、CC), the ISO member body for Canada and sponsor of the Canadian National Committee of the IEC. Also, as a member of the International Telecommunication Union (ITU), Canada participates in the International Telegraph and Telephone Consultative Committee (ITU-T).This Standard supersedes CAN/CSA-ISO/IE

21、C 13249-2:02 (adoption of ISO/IEC 13249-2:2000).This International Standard was reviewed by the CSA TCIT under the jurisdiction of the Strategic Steering Committee on Information Technology and deemed acceptable for use in Canada. (A committee membership list is available on request from the CSA Pro

22、ject Manager.) From time to time, ISO/IEC may publish addenda, corrigenda, etc. The CSA TCIT will review these documents for approval and publication. For a listing, refer to the CSA Information Products catalogue or CSA Info Update or contact a CSA Sales representative. This Standard has been forma

23、lly approved as a National Standard of Canada by the Standards Council of Canada.December 2004 Canadian Standards Association 2004All rights reserved. No part of this publication may be reproduced in any form whatsoever without the prior permission ofthe publisher. ISO/IEC material is reprinted with

24、 permission. Where the words “this International Standard” appear in the text, they should be interpreted as “this National Standard of Canada”.Inquiries regarding this National Standard of Canada should be addressed toCanadian Standards Association5060 Spectrum Way, Suite 100, Mississauga, Ontario,

25、 Canada L4W 5N61-800-463-6727 416-747-4044www.csa.caReference numberISO/IEC 13249-2:2003(E)ISO/IEC 2003INTERNATIONAL STANDARD ISO/IEC13249-2Second edition2003-11-01Information technology Database languages SQL multimedia and application packages Part 2: Full-Text Technologies de linformation Langage

26、s de bases de donnes Multimdia SQL et paquetages dapplication Partie 2: Texte complet ISO/IEC 13249-2:2003(E) PDF disclaimer This PDF file may contain embedded typefaces. In accordance with Adobes licensing policy, this file may be printed or viewed but shall not be edited unless the typefaces which

27、 are embedded are licensed to and installed on the computer performing the editing. In downloading this file, parties accept therein the responsibility of not infringing Adobes licensing policy. The ISO Central Secretariat accepts no liability in this area. Adobe is a trademark of Adobe Systems Inco

28、rporated. Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In the unlikely event th

29、at a problem relating to it is found, please inform the Central Secretariat at the address given below. ISO/IEC 2003 All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopyin

30、g and microfilm, without permission in writing from either ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.org ii ISO/IEC 2003 All rig

31、hts reservedISO/IEC 13249-2:2003(E) ISO/IEC 2003 - All rights reserved Contents iii Contents PageForeword. viiiIntroduction ix1 Scope 12 Normative references 33 Terms and definitions, notations and conventions . 53.1 Terms and definitions 53.1.1 Terms and definitions provided in ISO/IEC 13249-1:2002

32、. 5 3.1.2 Terms and definitions provided in this part of ISO/IEC 13249 53.1.3 Terms and definitions taken from ISO/IEC 9075 (all parts). 6 3.1.4 Terms and definitions taken from ANSI/NISO Z39.19:1993. 63.2 Notations. 73.3 Conventions . 84 Concepts. 94.1 Concepts taken from ISO/IEC 9075(all parts) 94

33、.2 Text model 104.3 Text identification facilities. 114.3.1 Single word patterns (patterns of the form ) 124.3.2 Single phrase patterns (patterns of the form ) . 124.3.3 Patterns representing sets of single words 124.3.4 Patterns formed by sets of single phrases . 144.3.5 Patterns specifying context

34、 conditions. 154.3.6 Patterns involving Boolean operators. 164.3.7 Identification of FullText values which are pertinent to a given text . 174.4 Text scoring facilities 184.5 Language aspects 194.5.1 Multilingual texts and patterns. 194.5.2 Treatment of stop words. 194.6 Word normalization 214.7 Typ

35、es and routines provided by this part of ISO/IEC 13249 224.7.1 Types and routines intended for public use . 224.7.2 Types and routines for definition. 224.7.3 Technique for defining the semantics of Category 1 Contains methods 224.7.4 Complementary SQL-invoked regular functions 234.8 The Full-Text I

36、nformation Schema.235 Full-Text Types. 255.1 FullText Type and Routines 255.1.1 FullText Type 255.1.2 Contains Methods 285.1.3 Score Methods . 305.1.4 NumberOfMatches Methods . 315.1.5 Tokenize Method 325.1.6 TokenizePosition Method 335.1.7 Segmentize Method . 355.1.8 TokenizeAndStem Method 365.1.9

37、TokenizePositionAndStem Method 375.1.10 FullText Methods 385.1.11 Contains Function 395.1.12 Score Function. 40ISO/IEC 13249-2:2003(E) ISO/IEC 2003 - All rights reserved iv Contents 5.1.13 NumberOfMatches Function. 415.1.14 FullText_to_Character Function. 425.1.15 StrctPattern_to_FT_Pattern Function

38、 435.2 FT_TokenPosition Type and Routines. 445.2.1 FT_TokenPosition Type. 445.3 FT_Pattern Type and Routines. 455.3.1 FT_Pattern Type. 455.3.2 FT_Pattern Key Words 596 Structured Search Pattern Types.616.1 FT_Any Type and Routines. 616.1.1 FT_Any Type. 616.1.2 Contains Method 636.1.3 FT_Any Method 6

39、56.2 FT_Primary Type and Routines 666.2.1 FT_Primary Type 666.2.2 Contains Method 676.2.3 StrctPattern_to_FT_Pattern Method 686.3 FT_WordOrPhrase Type and Routines 696.3.1 FT_WordOrPhrase Type 696.3.2 Contains Method 706.3.3 StrctPattern_to_FT_Pattern Method 716.3.4 getWordArray Method . 726.4 FT_Te

40、xtLiteral Type and Routines . 736.4.1 FT_TextLiteral Type . 736.4.2 Contains Method 756.4.3 NumberOfMatches Method . 776.4.4 StrctPattern_to_FT_Pattern Method 796.4.5 matches Method. 806.4.6 Tokenize Method 816.4.7 getWordArray Method . 826.4.8 FT_TextLiteral Methods. 836.4.9 EliminateDQS Function .

41、 846.4.10 InsertDQS Function . 856.5 FT_StemmedWord Type and Routines 866.5.1 FT_StemmedWord Type 866.5.2 Contains Method 886.5.3 StrctPattern_to_FT_Pattern Method 906.5.4 TokenizeAndStem Method 916.5.5 FT_StemmedWord Methods . 926.6 FT_Phrase Type and Routines . 936.6.1 FT_Phrase Type . 936.6.2 Con

42、tains Method 956.6.3 NumberOfMatches Method . 986.6.4 StrctPattern_to_FT_Pattern Method 1016.6.5 getWordArray Method . 1026.6.6 TokenizePosition Method 1036.6.7 FT_Phrase Methods. 1046.6.8 matches Function 1056.6.9 prune Function. 1076.7 FT_StemmedPhrase Type and Routines . 1086.7.1 FT_StemmedPhrase

43、 Type . 1086.7.2 Contains Method 1106.7.3 StrctPattern_to_FT_Pattern Method 1136.7.4 TokenizePositionAndStem Method 1146.7.5 FT_StemmedPhrase Methods. 1156.8 FT_Proxi Type and Routines 1176.8.1 FT_Proxi Type 1176.8.2 Contains Method 1186.8.3 StrctPattern_to_FT_Pattern Method 121ISO/IEC 13249-2:2003(

44、E) ISO/IEC 2003 - All rights reserved Contents v 6.8.4 FT_Proxi Method 1226.9 FT_Soundex Type and Routines 1236.9.1 FT_Soundex Type 1236.9.2 Contains Method 1246.9.3 StrctPattern_to_FT_Pattern Method 1256.9.4 FT_Soundex Method 1266.9.5 GetSoundsSimilar Function 1276.10 FT_Fuzzy Type and Routines . 1

45、286.10.1 FT_Fuzzy Type . 1286.10.2 Contains Method 1296.10.3 StrctPattern_to_FT_Pattern Method 1306.10.4 FT_Fuzzy Method. 1316.10.5 GetSpelledSimilar Function 1326.11 FT_BroaderTerm Type and Routines. 1336.11.1 FT_BroaderTerm Type. 1336.11.2 Contains Method 1346.11.3 StrctPattern_to_FT_Pattern Metho

46、d 1356.11.4 FT_BroaderTerm Method 1366.11.5 GetBroaderTerms Function 1376.12 FT_NarrowerTerm Type and Routines. 1396.12.1 FT_NarrowerTerm Type. 1396.12.2 Contains Method 1406.12.3 StrctPattern_to_FT_Pattern Method 1416.12.4 FT_NarrowerTerm Method 1426.12.5 GetNarrowerTerms Function 1436.13 FT_Synony

47、m Type and Routines . 1456.13.1 FT_Synonym Type . 1456.13.2 Contains Method 1466.13.3 StrctPattern_to_FT_Pattern Method 1476.13.4 FT_Synonym Method. 1486.13.5 GetSynonymTerms Function 1496.14 FT_PreferredTerm Type and Routines 1516.14.1 FT_PreferredTerm Type 1516.14.2 Contains Method 1526.14.3 Strct

48、Pattern_to_FT_Pattern Method 1536.14.4 FT_PreferredTerm Method 1546.14.5 GetPreferredTerms Function 1556.15 FT_RelatedTerm Type and Routines 1576.15.1 FT_RelatedTerm Type 1576.15.2 Contains Method 1586.15.3 StrctPattern_to_FT_Pattern Method 1596.15.4 FT_RelatedTerm Method . 1606.15.5 GetRelatedTerms

49、 Function. 1616.16 FT_TopTerm Type and Routines1636.16.1 FT_TopTerm Type 1636.16.2 Contains Method 1646.16.3 StrctPattern_to_FT_Pattern Method 1656.16.4 FT_TopTerm Method . 1666.16.5 GetTopTerms Function . 1676.17 FT_IsAbout Type and Routines 1696.17.1 FT_IsAbout Type 1696.17.2 Contains Method 1706.17.3 StrctPattern_to_FT_Pattern Method 1716.17.4 FT_IsAbout Method . 1726.18 FT_Context Type and Routines 1736.18.1 FT_Context Type 1736.18.2 Contains Method 1746.18.3 StrctPattern_to_FT_Pattern Method 1766.18.4 FT_Cont