ANSI INCITS ISO IEC 10641-1993 Computer Graphics and Image Processing - Conformance Testing of Implementations of Graphics Standards (Adopted by INCITS).pdf

1、 INCITS/ISO/IEC 10641-1993 (formerly ANSI/ISO/IEC 10641-1993)for Information Technology -Computer Graphics and Image Processing -Conformance Testing ofImplementations ofGraphics StandardsAmericanNationalStandardApproval of an American National Standard requires review by ANSI that therequirements fo

2、r due process, consensus, and other criteria for approval havebeen met by the standards developer.Consensus is established when, in the judgment of the ANSI Board of StandardsReview, substantial agreement has been reached by directly and materiallyaffected interests. Substantial agreement means much

3、 more than a simplemajority, but not necessarily unanimity. Consensus requires that all views andobjections be considered, and that a concerted effort be made toward theirresolution.The use of American National Standards is completely voluntary; their existencedoes not in any respect preclude anyone

4、, whether he has approved the standardsor not, from manufacturing, marketing, purchasing, or using products, processes,or procedures not conforming to the standards.The American National Standards Institute does not develop standards and will inno circumstances give an interpretation of any American

5、 National Standard.Moreover, no person shall have the right or authority to issue an interpretation ofan American National Standard in the name of the American National StandardsInstitute. Requests for interpretations should be addressed to the secretariat orsponsor whose name appears on the title p

6、age of this standard.CAUTION NOTICE: This American National Standard may be revised orwithdrawn at any time. The procedures of the American National StandardsInstitute require that action be taken periodically to reaffirm, revise, or withdrawthis standard. Purchasers of American National Standards m

7、ay receive currentinformation on all standards by calling or writing the American National StandardsInstitute.Published byAmerican National Standards Institute11 West 42nd Street, New York, New York 10036Copyright 1993 by Information Technology Industry Council (ITI)All rights reserved.These materia

8、ls are subject to copyright claims of International Standardization Organization (ISO),International Electrotechnical Commission (IEC), American National Standards Institute (ANSI), andInformation Technology Industry Council (ITI). Not for resale. No part of this publication may bereproduced in any

9、form, including an electronic retrieval system, without the prior written permission of ITI.All requests pertaining to this standard should be submitted to ITI, 1250 Eye Street NW, Washington, DC20005.Printed in the United States of AmericaANSI/ISO/IEC 10641-l 993 American National Standard for Info

10、rmation Technology - Computer Graphics and Image Processing - Conformance Testing of Implementations of Graphics Standards Secretariat Computer and Business Equipment Manufacturers Association Approved September 21, 1994 American National Standards Institute, Inc. Contents Scope . . . . . . . . . .

11、. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Normative references 2 Definitions OveZvievv . 4.1 Conformance testing . 4.2 Graphics conformance testing 4.2.1 The impact of registration 43.2 Interfaces in computer

12、 graphics conformance testing 4.3 The testing process . Counework given in this International Standard. together with the Test Requirements document for a particular gtaphics star _ To promote test suites that are appropriately defined for testing products for conformance to all areas of the sta - T

13、o promote test metbods for similar standards that are developed in a consistent way; - Topromoteconformanc e testing that is carried out in a consistent way throughout the international gtaphics community. Users of this Intemational Standard include: Developers of graphics standards; Implementors of

14、 graphics standards: Developers of gtaphics test suites: Testing laboratories: Certification bodies: Accreditation bodies. Annexes A and B contain diagrams ilhtstmting the relationships among the users of this International Standard and the information shared by them. vi AMERICAN NATIONAL STANDARD A

15、NSVlSOllEC 10641-l 993 - American National Standard for Information Technology - Computer Graphics and Image Processing - Conformance Testing of Implementations of Graphics Standards 1 Scope Thk International Standard specifies a general framework for testing conformance to a computer graphics stand

16、ard. The general framework described in this International Standard addmsses the following six components: - Conformance in the standard itself; - Test Requirements document, defining what shall be tested for a computer graphics standard; _ Test Specifications document, addressing the test technique

17、 and the content of each test; - Test method. defining the implementation of the Test Specification document, including the test softwate: Q- _ Test procedures, defining the application of the test software, which consists of the procedures to be used in conformance testing: _ - The establishment of

18、 test services. Thii International Standard is applicable to all standards within the scope of the subcommittee within ISO/IEC JTCl responsible for computer graphics and image processing. ISO/IEC 10641:1993 (E) 8 ISO/IEC 2 Normative references - The following standards contain provisions which, thro

19、ugh reference in this text. constitute provisions of this IntemationaI Standard. At the time of publication, the editions indicated were valid. AI1 standards are subject to revision, and parties to agreements based on this Intemzational Standard (integer coordinate space): - Commonly used value: (po

20、lymarker type in GKS); - Extreme value: ; - Illegal value: , . 16 0 ISO/IEC ISO/lEC 10641:19!43 (E) The output of test programs should be structured in order to ease checking either manually or automaticaIly. The Test Specifications document should be developed by test suite implementors and the IS0

21、 working group responsible for validation and testing. The document should not have formal status within ISO/IEC but should be available to interested parties. 6.2.3 Test suite and documentation A test suite is comprised of test software, test documentation, and test procedures. A test suite should

22、include tools and documents, such as operator scripts and reference pictures required to execute the tests. It should also include installation guidelines containing the following information: Programming language of the test programs, when applicable; Type of encoding, the communication mechanism a

23、nd, if available, the communication handler; Specification of the files (number, names) with the test input: Description of mainteruance procedures to report errors or ambiguities. The test software is made up of a set of test programs implemented according to the Test Specifications document and me

24、eting the req Adoption of a test report format; Issuance of licences for use of a test suite: Maintemance requirements. All of these items are discussed in the procedures and guidelines subclause (subclause 7.1). In addition, there is a requirement for a maintenance function to control the update of

25、 the test tools, test procedures and test report format. The structure of this area is also described. The following subclauses illustrate the procedures to be followed to establish a graphics test service (see 8.1.1 and 8.1.2). 7.1 Procedures and guidelines C 7.1.1 Acceptance of a test suite The fi

26、rst stage in the establishment of a graphics test service should be to ensure that the test ptograms to be used as the basis of the service are of acceptable quality. The test programs and ,associated documentation (test suite) should be subjected to an alpha test period carried out by the test suit

27、e developers and the testing laboratories. Following this, a test suite should be subjected to a beta test period. Several beta test sites should be selected, and a test suite wiU be made available to them for assessment for a period of time. Each country intending to operate a graphics test service

28、 for a standard should pnrticipate in the beta testing of the corresponding test suite. Following the beta testing period, a review of the test suite shouid be heid by the test suite developers, the testing laboratories, accreditation bodies and certification bodies and should address ,alI queries r

29、aised by the beta test sites. Following satisfactory completion of this phase, a test suite should be selected as the version to be used by all accredited testing laboratories for the graphics test service. 7.1.2 Establishment of test procedures The test procedures should be developed by the testing

30、 laboratories in conjunction with the test suite developers. The test procedures should define the procedures to be followed when applying a test suite to an IUT for the purpose of confomuance testing. 7.1.2.1 Testing Control Board A Testing Control Board should be established for the purpose of ide

31、ntifying questions of interpretation which 6arise during test suite development and when a test suite is being used for the putpose of conformance testing. The Testing Control Board then forwards these questions of interpretation to the subcommittee within ISO/IEC JTCl responsible for computer graph

32、ics for resolution. It should deal with queries about a test suite and be responsible for assisting clients with problems encountered. The Testing Control Board should include one representative from each testing laboratory and two representatives from the subcommittee within ISO/IEC JTCl responsibl

33、e for computer graphics. The Testing Control Board may add representatives from each certification body as well as test suite developers. The m,ain function of a Testing Control Board is to ensure that a test suite correctly tests for requirements in a standard. The Testing Control Board does this b

34、y making rulings to resolve disputes concerning interpretation of the test results between a testing laboratory and a client. The Testing Control Bonrd secretariat should maintain a file of all queries and rulings. Testing Control Board rulings should be strictly adhered to by testing laboratories a

35、nd certification bodies and their delegated representatives. 18 8 ISOiIEC ISO/IEC 10641:1993 (E) Terms of reference for a Testing Control Board should contain the following as a minimum: - Assist test suite developers on the technical content of a test suite; - Inform test suite developers and any a

36、uthorized testing laboratories on the withdrawal of tests that are deemed to be faulty and on their subsequent correction; *- Resolve disputes concerning interpretation of the results between a testing laboratory and a client; - Provide liaison statements to the subcommittee responsible for computer

37、 graphics within ISO/lEC JTCl regarding disputes concerning interpretation of the graphics standard: - Establish and maintain bison with the client, the testing laboratories, and test suite developers; - Maintain a record of decisions regarding the graphics standard and a test suite and test results

38、 (when the latter are published). The Testing Control Board should exist to provide a method of resolving queries in a hrannonised way. 7.1.2.2 Testing Control Board procedures The Testing Control Board should deal with alI queries from a client, test suite developer, or testing laboratory concernin

39、g a test suite or the gmphics standard. Queries from a client with respect to a test suite or test results should be sent by the testing laboratoj to the Testing Control Board secretariat, who forwards them to all members of the Testing Control Board. The Testing Control Bo,ard should provide a ruli

40、ng on the query to the secretariat, who forw,ards this to the testing laboratory who informs the client. The client should receive a decision on this query as soon as possible. Queries concerning a graphics standard should be forwarded to the subcommittee within ISO/IEC JTCl responsible for computer

41、 graphics for resolution. Voting procedures should be established for the Testing Control Board. The Testing Control Board should have the authority to withdraw a test case which is found to be incorrect or to rule a test case imappticable. If a test case is withdrawn, then it is with - The results

42、of aN tests. This information enables the testing Iaboratory to check that the client is using the graphics test suite correctly: - A signed statement to the testing laboratory specifying the exact configuration to be tested; - A completed questionmaire (provided by the testing laboratory) to provid

43、e information for the test report. - Any of the clients technical queries regarding preliminary testing, which cannot be resolved by the testing laboratory, should be passed to the Testing Control Board, who should give a ruling within a fixed timescale as defined in the Testing Control Board proced

44、ures; - When the customer is ready for testing, a mutually convenient date should be established between the testing laboratory and the client. 19 ISO/IEC 10641:1993 (E) 7.1.2.4 Testing procedures 0 ISO/IEC The following details which deal with official testing should be incorporated into the test p

45、rocedures: - A test suite should be prepnred by the testing laboratory on a suitable data medium. Full details for test suite . creation should be documented by the testing laboratory. Alternatively, M integrity checking method may be used to ensure that the clients copy of a test suite is correct a

46、nd unchanged. Such an integrity checking method should be a recognized part of a test suite; - The same version of a graphics test suite as used by the client for pre-validation should be used for testing; - Only the officiti graphics test suite provided by the testing laboratory should be used, and

47、 the client should be required to delete any other copies from the system to ensure that this is the case. If an integrity checking method is being used, then the integrity checker should be run on a test suite present on the system under test to ensure the correct version of a test suite is being u

48、sed; - If problems with conformity are encountered during testing, then the client should either perform testing with errors or withdraw from testing until the problems have been resolved. If any changes are made to the implementation, then testing sh,all start again from the beginning, discnrding t

49、esting data already accumulated: - Any modification made to the software environment during testing must be approved and documented by the testing * laboratory representative: if this does not occur, then all output produced thus far will be discarded and the testing procedure will be restarted from the first test routine; - Any changes to a graphics test suite (other th,an adaptations required for the test environment that am explicitly allowed) should not be allowed while testing is in progress. Any authorized changes required during testin