CAN CSA-ISO IEC 14651-2013 Information technology - International string ordering and comparison - Method for comparing character strings and description of the common template tai.pdf

1、Information technology Intern ational string ordering and comparison Method for comp aring character strings and description of the common template tailorable orderingCAN/CSA-ISO/IEC 14651:13(ISO/IEC 14651:2011, IDT)National Standard of CanadaNOT FOR RESALE. / PUBLICATION NON DESTINE LA REVENTE.Lega

2、l Notice for StandardsCanadian Standards Association (operating as “CSA Group”) develops standards through a consensus standards development process approved by the Standards Council of Canada. This process brings together volunteers representing varied viewpoints and interests to achieve consensus

3、and develop a standard. Although CSA Group administers the process and establishes rules to promote fairness in achieving consensus, it does not independently test, evaluate, or verify the content of standards.Disclaimer and exclusion of liabilityThis document is provided without any representations

4、, warranties, or conditions of any kind, express or implied, including, without limitation, implied warranties or conditions concerning this documents fitness for a particular purpose or use, its merchantability, or its non-infringement of any third partys intellectual property rights. CSA Group doe

5、s not warrant the accuracy, completeness, or currency of any of the information published in this document. CSA Group makes no representations or warranties regarding this documents compliance with any applicable statute, rule, or regulation. IN NO EVENT SHALL CSA GROUP, ITS VOLUNTEERS, MEMBERS, SUB

6、SIDIARIES, OR AFFILIATED COMPANIES, OR THEIR EMPLOYEES, DIRECTORS, OR OFFICERS, BE LIABLE FOR ANY DIRECT, INDIRECT, OR INCIDENTAL DAMAGES, INJURY, LOSS, COSTS, OR EXPENSES, HOWSOEVER CAUSED, INCLUDING BUT NOT LIMITED TO SPECIAL OR CONSEQUENTIAL DAMAGES, LOST REVENUE, BUSINESS INTERRUPTION, LOST OR D

7、AMAGED DATA, OR ANY OTHER COMMERCIAL OR ECONOMIC LOSS, WHETHER BASED IN CONTRACT, TORT (INCLUDING NEGLIGENCE), OR ANY OTHER THEORY OF LIABILITY, ARISING OUT OF OR RESULTING FROM ACCESS TO OR POSSESSION OR USE OF THIS DOCUMENT, EVEN IF CSA GROUP HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES, IN

8、JURY, LOSS, COSTS, OR EXPENSES.In publishing and making this document available, CSA Group is not undertaking to render professional or other services for or on behalf of any person or entity or to perform any duty owed by any person or entity to another person or entity. The information in this doc

9、ument is directed to those who have the appropriate degree of experience to use and apply its contents, and CSA Group accepts no responsibility whatsoever arising in any way from any and all use of or reliance on the information contained in this document. CSA Group is a private not-for-profit compa

10、ny that publishes voluntary standards and related documents. CSA Group has no power, nor does it undertake, to enforce compliance with the contents of the standards or other documents it publishes. Intellectual property rights and ownershipAs between CSA Group and the users of this document (whether

11、 it be in printed or electronic form), CSA Group is the owner, or the authorized licensee, of all works contained herein that are protected by copyright, all trade-marks (except as otherwise noted to the contrary), and all inventions and trade secrets that may be contained in this document, whether

12、or not such inventions and trade secrets are protected by patents and applications for patents. Without limitation, the unauthorized use, modification, copying, or disclosure of this document may violate laws that protect CSA Groups and/or others intellectual property and may give rise to a right in

13、 CSA Group and/or others to seek legal redress for such use, modification, copying, or disclosure. To the extent permitted by licence or by law, CSA Group reserves all intellectual property rights in this document.Patent rightsAttention is drawn to the possibility that some of the elements of this s

14、tandard may be the subject of patent rights. CSA Group shall not be held responsible for identifying any or all such patent rights. Users of this standard are expressly advised that determination of the validity of any such patent rights is entirely their own responsibility.Authorized use of this do

15、cumentThis document is being provided by CSA Group for informational and non-commercial use only. The user of this document is authorized to do only the following:If this document is in electronic form:sLOADTHISDOCUMENTONTOACOMPUTERFORTHESOLEPURPOSEOFREVIEWINGITsSEARCHANDBROWSETHISDOCUMENTANDsPRINTT

16、HISDOCUMENTIFITISIN0$ cet aspect demeurant la responsabilit permanente de lOEN. Toute NNC reflte un consensus raisonnable parmi les points de vue dun certain nombre de personnes comptentes dont les intrts runis forment, au degr le plus lev possible, une reprsentation quilibre des intrts des producte

17、urs, des organismes de rglementation, des utilisateurs (y compris les consommateurs) et dautres personnes intresses, selon le domaine envisag. Il sagit gnralement dune norme qui peut apporter une contribution apprciable, en temps opportun, lintrt national.Il est recommand aux personnes qui ont besoi

18、n de normes de se servir des Normes nationales du Canada. Ces normes font lobjet dexamens priodiques; cest pourquoi lon recommande aux utilisateurs de se procurer ldition la plus rcente de la norme auprs de lorganisme qui la publie.La responsabilit dapprouver les normes en tant que Normes nationales

19、 du Canada incombe au :Conseil canadien des normes270, rue Albert, bureau 200Ottawa (Ontario) K1P 6N7CanadaThis National Standard of Canada is available in English and French.Bien que le but premier vis par cette norme soit nonc sous sa rubrique Domainedapplication, il est important de retenir quil

20、incombe lutilisateur de juger si la normeconvient ses besoins particuliers.MCUne marque de commerce de lAssociation canadienne de normalisation,qui exerce ses activits sous le nom Groupe CSA. TMA trade-mark of the Canadian Standards Association, operating as “CSA Group”National Standard of CanadaPub

21、lished in January 2013 by CSA GroupA not-for-profit private sector organization5060 Spectrum Way, Suite 100, Mississauga, Ontario, Canada L4W 5N61-800-463-6727 416-747-4044Visit our Online Store at shop.csa.caApproved byStandards Council of CanadaCAN/CSA-ISO/IEC 14651:13Information technology Intern

22、ational string ordering and comparison Method for comparing character strings and description of the common template tailorable orderingPrepared by InternationalOrganizationforStandardization/ International Electrotechnical CommissionReviewed byCAN/CSA-ISO/IEC 14651:13Information technology Intern a

23、tional string ordering andcomparison Method for comp aring character strings anddescription of the common template tailorable orderingCSA/4 2013 CSA Group January 2013CAN/CSA-ISO/IEC 14651:13Information technology International string ordering and comparison Method for comparing character strings an

24、d description of the common template tailorable orderingCSA PrefaceStandards development within the Information Technology sector is harmonized with international standards development. Through the CSA Technical Committee on Information Technology (TCIT), Canadians serve as the Canadian Advisory Com

25、mittee (CAC) on ISO/IEC Joint Technical Committee 1 on Information Technology (ISO/IEC JTC1) for the Standards Council of Canada (SCC), the ISO member body for Canada and sponsor of the Canadian National Committee of the IEC. Also, as a member of the International Telecommunication Union (ITU), Cana

26、da participates in the International Telegraph and Telephone Consultative Committee (ITU-T).This Standard supersedes CAN/CSA-ISO/IEC 14651-08 (adoption of ISO/IEC 14651:2007).This International Standard was reviewed by the TCIT under the jurisdiction of the Strategic Steering Committee on Informatio

27、n Technology and deemed acceptable for use in Canada. From time to time, ISO/IEC may publish addenda, corrigenda, etc. The TCIT will review these documents for approval and publication. For a listing, refer to the Current Standards Activities page at standardsactivities.csa.ca. This Standard has bee

28、n formally approved, without modification, by the Technical Committee and has been approved as a National Standard of Canada by the Standards Council of Canada. 2013 CSA GroupAll rights reserved. No part of this publication may be reproduced in any form whatsoever without the prior permission of the

29、publisher. ISO/IEC material is reprinted with permission. Where the words “this International Standard” appear in the text, they should be interpreted as “this National Standard of Canada”.Inquiries regarding this National Standard of Canada should be addressed toCSA Group5060 Spectrum Way, Suite 10

30、0, Mississauga, Ontario, Canada L4W 5N61-800-463-6727 416-747-4000http:/csa.caTo purchase standards and related publications, visit our Online Store at shop.csa.ca or call toll-free 1-800-463-6727 or 416-747-4044.This Standard is subject to periodic review, and suggestions for its improvement will b

31、e referred to the appropriate committee. To submit a proposal for change, please send the following information to inquiriescsagroup.org and include “Proposal for change” in the subject line:(a) Standard designation (number);(b) relevant clause, table, and/or figure number;(c) wording of the propose

32、d change; and(d) rationale for the change.Reference numberISO/IEC 14651:2011(E)ISO/IEC 2011INTERNATIONAL STANDARD ISO/IEC14651Third edition2011-08-15Information technology International string ordering and comparison Method for comparing character strings and description of the common template tailo

33、rable ordering Technologies de linformation Classement international et comparaison de chanes de caractres Mthode de comparaison de chanes de caractres et description du modle commun et adaptable dordre de classement ISO/IEC 14651:2011(E) COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2011 All rights reserved

34、. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISOs member body in the country of the requester.

35、 ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.org Web www.iso.org ii ISO/IEC 2011 All rights reservedCAN/CSA-ISO/IEC 14651:13 ISO/IEC 14651:2011(E) ISO/IEC 2011 All rights reserved iiiContents Page Foreword . v Introduction v

36、i 1 Scope 1 2 Conformance . 2 3 Normative references 2 4 Terms and definitions . 2 5 Symbols and abbreviations 4 6 String comparison . 4 6.1 Preparation of character strings prior to comparison . 4 6.2 Key building and comparison 4 6.2.1 Preliminary considerations 4 6.2.2 Reference ordering key form

37、ation . 5 6.2.3 Reference comparison method for ordering character strings 7 6.3 Common Template Table: formation and interpretation . 8 6.3.1 BNF syntax rules for the Common Template Table in Annex A . 8 6.3.2 Well-formedness conditions 11 6.3.3 Interpretation of tailored tables . 12 6.3.4 Evaluati

38、on of weight tables 13 6.3.5 Conditions for considering specific table equivalences . 14 6.3.6 Conditions for results to be considered equivalent 14 6.4 Declaration of a delta 14 6.5 Name of the Common Template Table and name declaration 16 Annex A (normative) Common Template Table . 17 Annex B (inf

39、ormative) Example tailoring deltas 18 B.1 Example 1 Minimal tailoring 18 B.2 Example 2 Reversing the order of lowercase and uppercase letters 18 B.3 Example 3 Canadian delta and benchmark 18 B.4 Example 4 Danish delta and benchmark 21 B.5 Example 5 A tailoring for Khmer . 24 Annex C (informative) Pr

40、eparation 26 C.1 General considerations . 26 C.2 Thai string ordering . 26 C.2.1 Thai ordering principles 27 C.2.2 Vowel/consonant rearrangement . 27 C.2.3 Example ordered strings 29 C.3 Handling of numeral substrings in collation 29 C.3.1 Handling of ordinary numerals for natural numbers . 30 C.3.2

41、 Handling of positional numerals in other scripts 32 C.3.3 Handling of other non-pure positional system numerals or non-positional system numerals (e.g. Roman numerals) . 32 C.3.4 Handling of numerals for whole numbers 33 C.3.5 Handling of positive positional numerals with fractional parts . 34 C.3.

42、6 Handling of positive positional numerals with fraction parts and exponent parts 35 C.3.7 Handling of date and time of day indications . 36 C.3.8 Making numbers less significant than letters 37 C.3.9 Maintaining determinacy 37 CAN/CSA-ISO/IEC 14651:13 ISO/IEC 14651:2011(E) iv ISO/IEC 2011 All right

43、s reservedC.4 Preprocessing Hangul .38 C.4.1 Step 1 38 C.4.2 Step 2 38 C.4.3 Step 3 39 C.4.4 Step 4 39 Annex D (informative) Tutorial on solutions brought by this International Standard to problems of lexical ordering 40 D.1 Problems .40 D.2 Solution .41 D.3 Tailoring 42 Bibliography 44 CAN/CSA-ISO/

44、IEC 14651:13 ISO/IEC 14651:2011(E) ISO/IEC 2011 All rights reserved vForeword ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC par

45、ticipate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmen

46、tal and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2

47、. The main task of the joint technical committee is to prepare International Standards. Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as an International Standard requires approval by at least 75 % of the national bod

48、ies casting a vote. Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. ISO/IEC 14651 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology, Subcommittee SC 2, Coded character sets. This third edition cancels and replaces the second edition (ISO/IEC 14651:2007), which has been technically revised. It also incorpora