1、BSI Standards PublicationBS ISO/IEC 14651:2016Information technology International string orderingand comparison Method forcomparing character stringsand description of the commontemplate tailorable orderingBS ISO/IEC 14651:2016 BRITISH STANDARDNational forewordThis British Standard is the UK implem
2、entation of ISO/IEC14651:2016. It supersedes BS ISO/IEC 14651:2011+A2:2015 whichis withdrawn.The UK participation in its preparation was entrusted to TechnicalCommittee IST/5, Programming languages, their environments andsystem software interfaces.A list of organizations represented on this committe
3、e can beobtained on request to its secretary.This publication does not purport to include all the necessaryprovisions of a contract. Users are responsible for its correctapplication. The British Standards Institution 2016. Published by BSI StandardsLimited 2016ISBN 978 0 580 89369 8ICS 35.040Complia
4、nce with a British Standard cannot confer immunity fromlegal obligations.This British Standard was published under the authority of theStandards Policy and Strategy Committee on 29 February 2016.Amendments issued since publicationDate Text affectedBS ISO/IEC 14651:2016Information technology Internat
5、ional string ordering and comparison Method for comparing character strings and description of the common template tailorable orderingTechnologies de linformation Classement international et comparaison de chanes de caractres Mthode de comparaison de chanes de caractres et description du modle commu
6、n et adaptable dordre de classementINTERNATIONAL STANDARDISO/IEC14651Reference numberISO/IEC 14651:2016(E)Fourth edition2016-02-15 ISO/IEC 2016BS ISO/IEC 14651:2016ii ISO/IEC 2016 All rights reservedCOPYRIGHT PROTECTED DOCUMENT ISO/IEC 2016, Published in Switzerlandnullll nullnullnullhtnull nullenul
7、lenullnulled. nullnlenullnull othenullnullnullnulle nullnullenullnullnullnullednull no nullanullt onull thnullnull nullnullnulllnullnullatnullon nullanull nulle nullenullnullodnullnulled onull nulltnulllnullnulled othenullnullnullnulle nulln annull nullonullnull onull nullnull annull nulleannullnull
8、 elenulltnullonnullnull onull nullenullhannullnullalnull nullnnulllnulldnullnnull nullhotonullonullnullnullnnullnull onull nullonulltnullnnull on the nullntenullnet onull an nullntnullanetnull nullnullthonullt nullnullnullonull nullnullnulltten nullenullnullnullnullnullnullon. Penullnullnullnullnull
9、nullon nullan nulle nullenullnullenullted nullnullonull enullthenull nullnullnull at the addnullenullnull nullelonull onull nullnullnullnullnull nullenullnullenull nullodnull nulln the nullonullntnullnull onull the requester.nullnullnull nullonullnullnullnullnullht onullnullnullnulleCh. de Blandonne
10、t 8 CP 401CH-1214 Vernier, Geneva, SwitzerlandTel. +41 22 749 01 11Fax +41 22 749 09 47nullonullnullnullnullnullhtnullnullnullo.onullnullwww.iso.orgISO/IEC 14651:2016(E)BS ISO/IEC 14651:2016ISO/IEC 14651:2016(E)Foreword ivIntroduction v1 Scope . 12 Conformance . 23 Normative references 24 Terms and
11、definitions . 25 Symbols and abbreviations . 36 String comparison . 46.1 Preparation of character strings prior to comparison 4null.null nullenull nullnullnullldnullnnull and nullonullnullanullnullnullon. 4null.null.1 Pnullelnullnullnullnanullnull nullonnullnulldenullatnullonnull 4null.null.null nul
12、lenullenullennulle onulldenullnullnnull nullenull nullonullnullatnullon 66.2.3 Reference comparison method for ordering character strings . 76.3 Common Template Table: Formation and interpretation 8null.null.1 Bnullnull nullnullntanull nullnulllenull nullonull the Conullnullon nullenullnulllate null
13、anullle nulln nullnnenull null . 86.3.2 Well-formedness conditions . 106.3.3 Interpretation of tailored tables 126.3.4 Evaluation of weight tables 13null.null.null Condnulltnullonnull nullonull nullonnullnulldenullnullnnull nullnullenullnullnullnullnull tanullle enullnullnullnullalennullenull 136.3.
14、6 Conditions for results to be considered equivalent 136.4 Declaration of a delta 136.5 Name of the Common Template Table and name declaration 16Annex A (normative) Common Template Table .17Annex B (informative) Example tailoring deltas .18Annex C (informative) Preparation .27Annex D (informative) T
15、utorial on solutions brought by this International Standard to problems of lexical ordering .43Annex E (informative) Searching and fuzzy matches .47Bibliography .49 ISO/IEC 2016 All rights reserved iiiContents PageBS ISO/IEC 14651:2016ISO/IEC 14651:2016(E)ForewordISO (the International Organization
16、for Standardization) and IEC (the International Electrotechnical Conullnullnullnullnullnullonnull nullonullnull the nullnullenullnullalnullnulled nullnullnulltenull nullonull nullonullldnullnullde nulltandanulldnullnullatnullon. nullatnullonal nullodnullenull that anulle members of ISO or IEC partic
17、ipate in the development of International Standards through technical nullonullnullnulltteenull enulltanulllnullnullhed nullnull the nullenullnullenulltnullnulle onullnullannullnullatnullon to deal nullnullth nullanulltnullnullnulllanull nullnulleldnull onull tenullhnnullnullal anulltnullnullnulltnu
18、ll. nullnullnull and nullnullC tenullhnnullnullal nullonullnullnulltteenull nullollanullonullate nulln nullnulleldnull onull nullnulltnullal nullntenullenullt. nullthenull nullntenullnatnullonal organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the null
19、onullnull. nulln the nullnulleld onull nullnnullonullnullatnullon tenullhnolonullnullnull nullnullnull and nullnullC hanulle enulltanulllnullnullhed a nullonullnt tenullhnnullnullal nullonullnullnulltteenull ISO/IEC JTC 1.The procedures used to develop this document and those intended for its furthe
20、r maintenance are described in the ISO/IEC Directives, Part 1. In particular the different approval criteria needed for the dnullnullnullenullent tnullnullenull onull donullnullnullent nullhonullld nulle noted. nullhnullnull donullnullnullent nullanull dnullanullted nulln anullnullonulldannulle null
21、nullth the editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives). nullttentnullon nullnull dnullanulln to the nullonullnullnullnullnulllnulltnull that nullonulle onull the elenullentnull onull thnullnull donullnullnullent nullanull nulle the nullnullnullnullenullt onull null
22、atent nullnullnullhtnull. nullnullnull and nullnullC nullhall not nulle held nullenullnullonnullnullnullle nullonull nulldentnullnullnullnullnnull annull onull all nullnullnullh nullatent nullnullnullhtnull. nulletanulllnull onull annull nullatent nullnullnullhtnull nulldentnullnullnulled dnullnulln
23、ullnnull the denullelonullnullent onull the donullnullnullent nullnullll nulle nulln the Introduction and/or on the ISO list of patent declarations received (see www.iso.org/patents). nullnnull tnullade nanulle nullnulled nulln thnullnull donullnullnullent nullnull nullnnullonullnullatnullon nullnul
24、lnullen nullonull the nullonnullennullennulle onull nullnullenullnull and doenull not constitute an endorsement.nullonull an enullnulllanatnullon on the nulleannullnnull onull nullnullnull nullnullenullnullnullnullnull tenullnullnull and enullnullnullenullnullnullonnull nullelated to nullonnullonull
25、nullnulltnull assessment, as well as information about ISOs adherence to the WTO principles in the Technical Barriers to Trade (TBT) see the following URL: nullonullenullonulld null nullnullnullnulllenullentanullnull nullnnullonullnullatnullonThe committee responsible for this document is ISO/IEC JT
26、C 1, Information technology, SC 2, Coded character sets.This fourth edition cancels and replaces the third edition (ISO/IEC 14651:2011), which has been tenullhnnullnullallnull nullenullnullnulled.iv ISO/IEC 2016 All rights reservedBS ISO/IEC 14651:2016ISO/IEC 14651:2016(E)IntroductionThis Internatio
27、nal Standard provides a method, applicable around the world, for ordering text data, and provides a Common Template Table which, when tailored, can meet a given languages ordering requirements while retaining reasonable ordering for other scripts.The Common Template Table requires some tailoring in
28、different local environments. Conformance to this International Standard requires that all deviations from the template, called “deltas”, be declared to document resultant discrepancies.nullhnullnull nullntenullnatnullonal nulltandanulld denullnullnullnullnullenull a nullethod to onulldenull tenullt
29、 data nullndenullendentlnull onull nullontenullt.nullnullnullnullnullnullC nullnull null011null hanull nullnullenullnullnullnullnullatnullonnull nullonull onulldenullnullnnull that nullnnullonullnullatnullnullelnull nullonullnulllenullent the nullnullenullnullnullnullnullatnullonnull in this Interna
30、tional Standard and indicates where additional information can be sought on ordering nullenullnullonulldnull denullnullned nulln thnullnull nullntenullnatnullonal nulltandanulld. ISO/IEC 2016 All rights reserved vBS ISO/IEC 14651:2016BS ISO/IEC 14651:2016Information technology International string o
31、rdering and comparison Method for comparing character strings and description of the common template tailorable ordering1 Scopenullhnullnull nullntenullnatnullonal nulltandanulld denullnullnenull the nullollonullnullnnull. A reference comparison method. This method is applicable to two character str
32、ings to determine their collating order in a sorted list. The method can be applied to strings containing characters from the full repertoire of ISO/IEC 10646. This method is also applicable to subsets of that repertoire, nullnullnullh anull thonulle onull the dnullnullnullenullent nullnullnullnulln
33、ullnullC 8nullnullnullt nulltandanulld nullhanullanulltenull nulletnullnull onull annull othenull nullhanullanulltenull nulletnull standardized or not, to produce ordering results valid (after tailoring) for a given set of languages for each script. This method uses collation tables derived either f
34、rom the Common Template Table denullnullned nulln thnullnull nullntenullnatnullonal nulltandanulld onull nullnullonull one onull nulltnull tanulllonullnullnnullnull. nullhnullnull nullethod nullnullonullnulldenull a nullenullenullennulle format. The format is described using the Backus-Naur Form (BN
35、F). This format is used to describe the Conullnullon nullenullnulllate nullanullle. nullhe nullonullnullat nullnull nullnulled nonullnullatnullnullelnull within this International Standard.null null Conullnullon nullenullnulllate nullanullle. null nullnullnullen tanulllonullnullnnull onull the Conul
36、lnullon nullenullnulllate nullanullle nullnull nullnulled nullnull the nullenullenullennulle comparison method. The Common Template Table describes an order for all characters encoded in the Unicode 8.0 standard, included in ISO/IEC 10646:2014 and its Amendment 1. It allows for a nullnullenullnullnu
37、llnullnullatnullon onull a nullnullllnull detenullnullnullnnullnulltnullnull onulldenullnullnnull. nullhnullnull tanullle enanulllenull the nullnullenullnullnullnullnullatnullon onull a nulltnullnullnnull ordering adapted to local ordering rules, without requiring an implementer to have knowledge of
38、 all the dnullnullnullenullent nullnullnullnullnulltnull alnulleadnull ennulloded nulln the nullnnullnullenullnullal Coded Chanullanulltenull nullet nullnullCnullnull.nullnullnullnull 1 nullhnullnull Conullnullon nullenullnulllate nullanullle nullnull to nulle nullodnullnullnulled to nullnullnullt t
39、he neednull onull a lonullal ennullnullnullonnullent. nullhe nullanulln nullonullldnullnullde nullenenullnullt nullnull thatnull nullonull othenull nullnullnullnullnulltnullnull onullten no nullodnullnullnullnullatnullon nullnull nullenullnullnullnulled and the onulldenull nullnullll nullenullanulln
40、 anull consistent as possible and predictable from an international point of view.NOTE 2 The character repertoire used in this International Standard is equivalent to that of the Unicode Standard version 6.0. A reference name. The reference name refers to this particular version of the Common Templa
41、te Table, for use as a reference when tailoring. In particular, this name implies that the table is linked to a particular stage of development of the ISO/IEC 10646 Universal coded character set. Requirements for a declaration of the differences (delta) between the collation table and the Common Tem
42、plate Table.This International Standard does not mandate the following.null null nullnullenullnullnullnullnull nullonullnullanullnullnullon nullethodnull annull enullnullnullnullalent nullethod nullnullnullnullnnull the nullanulle nullenullnullltnull nullnull anullnullenulltanullle.null null nullnul
43、lenullnullnullnullnull nullonullnullat nullonull denullnullnullnullnullnullnnull onull tanulllonullnullnnull tanulllenull nulln a nullnullnullen nullnullnulllenullentatnullon.null nullnullenullnullnullnullnull nullnullnullnullolnull to nulle nullnulled nullnull nullnullnulllenullentatnullonnullnull
44、enullnullenullt nullonull the nanulle onull the Conullnullon nullenullnulllate nullanullle.null nullnnull nullnullenullnullnullnullnull nullnullenull nullntenullnullanulle nullonull nullhoonullnullnnull onulltnullonnull.null nullnnull nullnullenullnullnullnullnull nullntenullnal nullonullnullat null
45、onull nullntenullnullednullate nullenullnull nullnulled nullhen nullonullnullanullnullnnullnull nonull nullonull the tanullle nullnulled. nullhe nullnulle onull nnullnullenullnullnull nullenullnull nullnull not nullandated enullthenull. A context-dependent ordering.null nullnnull nullanulltnullnulln
46、ulllanull nullnullenullanullatnullon onull nullhanullanulltenull nulltnullnullnnullnull nullnullnullonull to nullonullnullanullnullnullon.INTERNATIONAL STANDARD ISO/IEC 14651:2016(E) ISO/IEC 2016 All rights reserved 1BS ISO/IEC 14651:2016ISO/IEC 14651:2016(E)nullnullnullnull nullt nullnull nonullnul
47、lallnull nenullenullnullanullnull to do nullnullenullanullatnullon onull nullhanullanulltenull nulltnullnullnnullnull nullnullnullonull to nullonullnullanullnullnullon enullen nullnull nullt nullnull not nullnullenullnullnullnullnulled nullnull thnullnull nullntenullnatnullonal nulltandanulld nullnu
48、llee Annex C).nulllthonullnullh no nullnullenull nullntenullnullanulle nullnull nullenullnullnullnulled to nullhoonulle onulltnullonnull onull to nullnullenullnullnullnull tanulllonullnullnnull onull the Conullnullon nullenullnulllate nullanulllenull nullonnullonullnullannulle nullenullnullnullnulle
49、null alnullanullnull denulllanullnullnnull the anullnulllnullnullanullle deltanull a denulllanullatnullon onull dnullnullnullenullennullenull nullnullth this table. It is recommended that processes present available tailoring options to users.2 ConformanceA process is conformant to this International Standard if it produces results identical to those that nullenullnulllt nullnullonull the anullnulllnullnullatnullon onull the nullnullenullnullnullnullnullatnullonnull nullnullnullen nulln 6.2 to 6.5.null denulllanullatnullon onull nullonnullonul
