1、v0M*!/o a?so too? D)D KlruDiDQ2GQ0 sotf) exsfcflteODsa anxaa? Gate SHffiosoai? OraGsorasfl Copyright International Civil Aviation Organization Provided by IHS under license with ICAONot for ResaleNo reproduction or networking permitted without license from IHS-,-,-.OAC. Clr318 AN/180 Language Testin
2、g Criteria for Global Harmonization Approved by the Secretary General and published under his authority International Civil Aviation Organization Copyright International Civil Aviation Organization Provided by IHS under license with ICAONot for ResaleNo reproduction or networking permitted without l
3、icense from IHS-,-,-Published in separate English, Arabic, Chinese, French, Russian and Spanish editions by the INTERNATIONAL CIVIL AVIATION ORGANIZATION 999 University Street, Montreal, Quebec, Canada H3C 5H7 For ordering information and for a complete listing of sales agents and booksellers, pleas
4、e go to the ICAO website at www.icao.int ICAO Cir 318, Language Testing Criteria for Global Harmonization Order Number: CIR318 ISBN 978-92-9231-271-8 ICAO 2009 All rights reserved. No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means,
5、 without prior permission in writing from the International Civil Aviation Organization. W Copyright International Civil Aviation Organization Provided by IHS under license with ICAONot for ResaleNo reproduction or networking permitted without license from IHS-,-,-FOREWORD 1. Assembly Resolution A36
6、-11, Proficiency in the English language used for radiotelephony communications, directed the Council to support Contracting States in their implementation of the language proficiency requirements by establishing globally harmonized language testing criteria. 2. Organizing aviation language testing
7、is one of several steps necessary to effectively implement the ICAO language proficiency requirements. ICAO has previously published detailed “Implementation Guidelines“ for aviation language requirements; these are available at http:/www.icao.int/fsix/lp.cfm. 3. While the Manual on the Implementati
8、on of ICAO Language Proficiency Requirements (Doc 9835), published in September 2004, provided some guidance on testing, users of the manual including licensing authorities, air operators, air navigation service providers, and language training and testing services have indicated that more detailed
9、guidance on language testing is needed to effectively implement the language proficiency requirements. The purpose of this circular is to address that need. (HO Copyright International Civil Aviation Organization Provided by IHS under license with ICAONot for ResaleNo reproduction or networking perm
10、itted without license from IHS-,-,-TABLE OF CONTENTS Page Chapter 1. Introduction 1 1. Overview2. Background 2 3. Introduction to Language Testing 4 4. Aviation-Specific Language Testing Issues 8 Chapter 2. Recommended Criteria for Aviation Language Testing 11 1. Test Design and Construct 12. Test V
11、alidity and Reliability 6 3. Rating ; 17 4. Test Administration and Security 19 5. Organizational Information and Infrastructure 25 6. Testing Team Qualifications 26 Chapter 3. Checklist 0 1. Test Design and Construct 30 * 2. Test Validity and Reliability 1 3. Rating4. Test Administration and Securi
12、ty 32 5. Organizational Information and Infrastructure 34 6. Testing Team QualificationsGlossary of Language Proficiency and Language Testing Terms and Acronyms 36 M Copyright International Civil Aviation Organization Provided by IHS under license with ICAONot for ResaleNo reproduction or networking
13、 permitted without license from IHS-,-,-Chapter 1 INTRODUCTION 1. OVERVIEW 1.1 Purpose The purpose of this circular is to provide guidance to civil aviation authorities and test service providers in processes for testing- candidates in accordance with the ICAO language proficiency requirements. In p
14、articular, it provides recommended criteria to guide the development or selection of aviation language testing programmes, as well as additional guidance material in that regard. The recommended aviation language testing criteria outlined in this circular were drawn from principles of best practices
15、 by the Proficiency Requirements in Common English Study Group (PRICESG) in 2005. They are intended to support the harmonization of global aviation language testing. 1.2 Target Audience 1.2.1 This publication will be useful to civil aviation and licensing authorities that oversee language testing an
16、d will provide State authorities, airlines and air navigation service providers with a set of practical tools. Civil aviation and licensing authorities may use these criteria: a) as a guide to development, should they decide to assign national resources to develop aviation language testing; and b) a
17、s a checklist against which to compare and assess externally developed aviation language tests; 1.2.2 Language testing organizations may use the criteria as a guide to provide the information and evidence to document that they comply with the criteria and to establish the integrity of their test. 1.
18、3 Applicability to all languages The ICAO language proficiency requirements (LPRs), which apply to all languages used in international radiotelephony communications, create a significant testing requirement This is particularly true with respect to English which is the language for which most traini
19、ng and testing programmes need to be developed. While this circular focuses on criteria guiding the development or selection of language tests in English, the principles apply equally to tests developed for any language used for international radiotelephony communications. 1.4 Context The recommende
20、d criteria in this guidance material are considered appropriate to the diverse contexts in which aviation language testing occurs. The principles underlying these criteria suit various operational and regulatory needs at various points of application within each particular administration. 1 Copyrigh
21、t International Civil Aviation Organization Provided by IHS under license with ICAONot for ResaleNo reproduction or networking permitted without license from IHS-,-,-2 ICAO Circular 318-AN/180 1.5 Structure Chapter 1 - Introduction. Presents the background and context, with references to other appro
22、priate ICAO publications and guidance material. Chapter 2- Recommended Criteria for Aviation Language Testing. Presents the criteria. Each criterion includes: what it means, why it is important and, where applicable, additional information. Chapter 3 - Checklist. Provides the recommended criteria in
23、 checklist format Glossary of Language Proficiency and Language Testing Terms and Acronyms 2. BACKGROUND 2.1 ICAO language proficiency requirements 2.1.1 The decision to address language proficiency for pilots and air traffic controllers was first made by the 32nd Session of the Assembly in Septembe
24、r 1998 as a direct response to several fatal accidents, including one that cost the lives of 349 persons, as well as to previous fatal accidents in which the lack of proficiency in English was identified as a contributing factor. 2.1.2 Subsequently, the Air Navigation Commission initiated the develo
25、pment of language provisions in the following Annexes to the Convention on International Civil Aviation and PANS: a) Annex 1 Personnel Licensing; b) Annex 6 Operation of Aircraft; c) Annex 10 Aeronautical Telecommunications, Volume II; and d) Annex 11 Air Traffic Services e) PANS-ATM 2.1.3 In March
26、2003, the ICAO Council adopted a comprehensive set of Standards and Recommended Practices (SARPs) that strengthened language proficiency requirements for pilots and air traffic controllers involved in international operations. These language proficiency requirements affirmed that ICAO standardized p
27、hraseology should be used whenever possible and required that when phraseology is not applicable, pilots and air traffic controllers should demonstrate a minimum level of proficiency in plain language. The effective use of plain language is vital in routine operational situations in which phraseolog
28、y provides no “ready-made“ form of communication and is especially critical in unusual or emergency situations. The minimum skill level requirements are embodied in the ICAO language proficiency rating scale and the holistic descriptors that appear in Attachment A and Appendix 1 of Annex 1, respecti
29、vely. 2.1.4 As of 5 March 2008, the ability to speak and understand the language used for radiotelephony that is currently required for pilots, air traffic controllers and aeronautical station operators should be demonstrated based on the holistic descriptors and language proficiency rating scale to
30、 at least Level 4. Level 4 is considered the minimum level of proficiency to ensure an acceptable level of safety. Additionally, since November 2003, Annex 10, Volume II, has required the availability of English at all stations on the ground serving designated airports and routes used by internation
31、al air services. Copyright International Civil Aviation Organization Provided by IHS under license with ICAONot for ResaleNo reproduction or networking permitted without license from IHS-,-,-ICAO Circular 318-AN/180 3 2.2 ICAO support and guidance ICAO has provided Contracting States with implementa
32、tion support in a number of ways, primarily through symposia, regional seminars and workshops, and the publication of guidance material: a) First ICAO Aviation Language Symposium September 2004, Montreal; b) Doc 9835, Manual on the Implementation of ICAO Language Proficiency Requirements, published
33、in September 2004; c) Regional seminars Japan (2004); Argentina, Azerbaijan, Belgium, Ukraine (2005); China (Hong Kong), France, Mexico, Senegal (2006); Egypt, France, Germany (2007); d) Rated Speech Samples CD A set of Rated Speech Samples developed and published by ICAO in 2006. Samples of speech
34、at ICAO Pre-Operational Level 3, Operational Level 4, and Extended Level 5 are provided, with full explanations and rationale for the assignment of each level. This CD is available for purchase from ICAO (contact: salesicao.int); e) Second ICAO Aviation Language Symposium May 2007, Montreal; f) Regi
35、onal workshops on the development of States implementation plans for language proficiency requirements Belarus, Peru (2007); El Salvador, Mexico, Senegal, Thailand, Uganda, United Arab Emirates (2008); g) Implementation of language proficiency requirements website (http:/www.icao.int/fsix/lp.cfm) Fu
36、rther to the adoption of Assembly Resolution A36-11, States can find information concerning States level of compliance with the language proficiency requirements and their implementation plans, as well as other implementation guidance, on this website; and h) ICAO Frequently Asked Questions (FAQs) w
37、ebsite (http:/www.icao.int/icao/en/trivia/ peltrgFAQ.htm) updated with information regarding the ICAO language proficiency requirements. 2.3 ICAO Assembly Resolution A36-11 Assembly Resolution A36-11, Proficiency in the English language used for radiotelephony communications, directed the Council to
38、 support Contracting States in their implementation of the language proficiency requirements by establishing globally harmonized language testing criteria.,The circular is a direct outcome of A36-11. 2.4 Frame of reference 2.4.1 While some regional and national language testing certification program
39、mes exist and some testing programmes are self-regulated, no universal system of aviation language testing certification has yet been developed. 2.4.2 The recommended language testing criteria presented herein are aligned with other ICAO guidance material. This circular should be considered a supple
40、ment to and not a replacement for other ICAO publications. Users should be familiar with the following: a) Doc 9835, Manual on the Implementation of ICAO Language Proficiency Requirements; b) ICAO Language Proficiency Requirements Rated Speech Samples; and c) the Frequently Asked Questions page at h
41、ttp:/www.icao.int/icao/en/trivia/peltrgFAQ.htm. Copyright International Civil Aviation Organization Provided by IHS under license with ICAONot for ResaleNo reproduction or networking permitted without license from IHS-,-,-4 ICAO Circular 318-AN/180 2.5 Scope 2.5.1 The recommended criteria and introd
42、uctory text in this chapter are intended as a guide only. The scope of this circular does not allow an exhaustive treatment of language testing. Neither this circular nor Doc 9835 is intended to replace the more extensive language testing standards, guidelines, and principles of ethics and good prac
43、tice that can be found in the literature on language testing. 2.5.2 Language testing is a specialized discipline. Expert professional input is recommended at every level of aviation language test implementation and selection but is essential for test development. 3. INTRODUCTION TO LANGUAGE TESTING
44、3.1 Language testing standards 3.1.1 Information about generic international language testing standards can be found on the websites of a number of testing associations such as: a) Association of Language Testers in Europe (ALTE) http:/www.alte.org; and b) International Language Testing Association
45、(ILTA) http:/ 3.1.2 However, it is important to recognize that existing academic or general-purpose language tests are not appropriate for the specialized domain of aviation language testing. The specific needs for aviation language testing are described below. 3.2 High stakes 3.2.1 A number of fact
46、ors make language proficiency testing for compliance with Annex 1 licensing requirements a case of exceptionally high-stakes testing. Inadequate aviation language testing could result in either serious safety gaps or highly negative social and economic consequences. 3.2.2 The results of language tes
47、ting seriously impact both individuals and organizations. A pilot or controller operating internationally who does not demonstrate compliance with the ICAO language proficiency requirements may be denied a licence to operate internationally, a consequence that may severely impact the career of that
48、individual, as well as the staffing requirements of the airline or air traffic service provider for whom the individual works. 3.2.3 In addition, the safety of airline passengers depends, among other issues, on the effectiveness of pilot and air traffic controller communications. Efficient transfer of operational information is vital. When the language used in radiotelephony communications is English, then reliable, effective, and valid testing systems are required to ensure that pilots and controllers have adequate levels of English language proficiency. 3.2.4 Finally, there ar
