ISO 10303-34-2001 Industrial automation systems and integration - Product data representation and exchange - Part 34 Conformance testing methodology and framewo.pdf

1、Reference number ISO 10303-34:2001(E) ISO 2001 INTERNATIONAL STANDARD ISO 10303-34 First edition 2001-02-01 Industrial automation systems and integration Product data representation and exchange Part 34: Conformance testing methodology and framework: Abstract test methods for application protocol im

2、plementations Systmes dautomatisation industrielle et intgration Reprsentation et change de donnes de produits Partie 34: Mthodologie et cadre gnral pour lvaluation de la conformit: Mthodes dvaluation abstraites pour les mises en application du protocole dapplicationISO 10303-34:2001(E) PDF disclaim

3、er This PDF file may contain embedded typefaces. In accordance with Adobes licensing policy, this file may be printed or viewed but shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading this file, parties acce

4、pt therein the responsibility of not infringing Adobes licensing policy. The ISO Central Secretariat accepts no liability in this area. Adobe is a trademark of Adobe Systems Incorporated. Details of the software products used to create this PDF file can be found in the General Info relative to the f

5、ile; the PDF-creation parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below. ISO 2001 All right

6、s reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISOs member body in the country of the

7、requester. ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copyrightiso.ch Web www.iso.ch Printed in Switzerland ii ISO 2001 All rights reserved ISO 10303-34:2001(E) iii Contents Page 1 Scope. 1 2 Normative references 1 3 Terms, definitions

8、and abbreviations. 2 3.1 Terms defined in ISO 10303-1 . 2 3.2 Terms defined in ISO 10303-11 . 2 3.3 Terms defined in ISO 10303-22 . 3 3.4 Terms defined in ISO 10303-31 . 3 3.5 Other terms and definitions 4 3.6 Abbreviations. 5 4 Overview and assumptions . 5 4.1 Components of exchange structure test

9、methods. 5 4.2 Processes of exchange structure test methods . 6 4.2.1 Preparation for testing. 6 4.2.2 Test campaign. 7 4.2.3 Analysis of results. 7 4.2.4 Report production . 7 5 Exchange structure test method - preprocessor 7 5.1 Model creation. 8 5.2 Exchange structure generation 8 5.3 Analysis. 9

10、 5.3.1 Syntax analysis . 9 5.3.2 Structure analysis 9 5.3.3 Semantic analysis 10 5.4 Verdict assignment. 10 5.5 Test case results reporting 11 6 Exchange structure test method - postprocessor. 11 6.1 Exchange structure interpretation . 12 6.2 Analysis. 12 6.2.1 Input handling analysis 13 6.2.2 Seman

11、tic analysis 13 6.3 Verdict assignment. 13 6.4 Test case results reporting 13 Annex A (normative) Information object registration . 14 Index . 15 ISO 2001 All rights reservedISO 10303-34:2001(E) iv Figures Figure 1 Preprocessor testing components. 8 Figure 2 Postprocessor testing components . 12 ISO

12、 2001 All rights reserved ISO 10303-34:2001(E) v Foreword ISO (the International Organization for Standardization) is a worldwide federation of national standards bodies (ISO member bodies). The work of preparing International Standards is normally carried out through ISO technical committees. Each

13、member body interested in a subject for which a technical committee has been established has the right to be represented on that committee. International organizations, governmental and non-governmental, in liaison with ISO, also take part in the work. ISO collaborates closely with the International

14、 Electrotechnical Commission (IEC) on all matters of electrotechnical standardization. Draft International Standards adopted by the technical committees are circulated to the member bodies for voting. Publication as an International Standard requires approval by at least 75 % of the member bodies ca

15、sting a vote. International Standard ISO 10303-34 was prepared by Technical Committee ISO/TC 184, Industrial automation systems and integration, Subcommittee SC 4, Industrial data. This International Standard is organized as a series of parts, each published separately. The parts of ISO 10303 fall i

16、nto one of the following series: description methods, integrated resources, application interpreted constructs, application protocols, abstract test suites, implementation methods, and conformance testing. The series are described in ISO 10303-1. A complete list of parts of ISO 10303 is available fr

17、om the Internet:Annex A forms a normative part of this part of ISO 10303. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 3. Attention is drawn to the possibility that some of the elements of this part of ISO 10303 may be the subject of patent r

18、ights. ISO shall not be held responsible for identifying any or all such patent rights. ISO 2001 All rights reservedISO 10303-34:2001(E) vi Introduction ISO 10303 is an International Standard for the computer-interpretable representation and exchange of product data. The objective is to provide a ne

19、utral mechanism capable of describing product data throughout the life cycle of a product, independent from any particular system. The nature of this description makes it suitable not only for neutral file exchange, but also as a basis for implementing and sharing product databases and archiving. Th

20、is part of ISO 10303 is a member of the conformance testing series. This part of ISO 10303 specifies the test methods used in the conformance testing of implementations which read and write 10303 exchange structures or share information with SDAI implementations based on a given ISO 10303 applicatio

21、n protocol. ISO 2001 All rights reservedINTERNATIONAL STANDARD ISO 10303-34:2001(E) 1 Industrial automation systems and integration Product data representation and exchange Part 34: Conformance testing methodology and framework: Abstract test methods for application protocol implementations 1 Scope

22、This part of ISO 10303 specifies the abstract test methods for conformance testing of an implementation of an ISO 10303 Application Protocol (AP). The scope is limited to the following implementation methods: preprocessors that claim to generate 10303 schema instances represented as exchange structu

23、res as defined by ISO 10303-21; postprocessors that claim to accept and process 10303 schema instances represented as exchange structures as defined by ISO 10303-21; preprocessors that claim to generate 10303 schema instances and use the SDAI interface as defined in ISO 10303-22 to populate an SDAI

24、implementation with these schema instances; postprocessors that claim to accept 10303 schema instances and use the SDAI interface as defined in ISO 10303-22 to extract schema instances from an SDAI implementation. The following are within the scope of this part of ISO 10303: the conformance assessme

25、nt process undertaken to evaluate the conformity of an implementation of an ISO 10303 application protocol. The abstract test methods are independently applicable to implementation methods based on ISO 10303-21 and ISO 10303-22; the methods to be followed by the testing laboratory using executable t

26、est cases (ETC). The methods presented are abstract, that is, they are independent of the implementation under test (IUT). The method descriptions cover the different steps from abstract test case (ATC) selection to test case report production. The following is outside the scope of this part of ISO

27、10303: the generation of executable test cases from abstract test cases. This part of ISO 10303 does not include abstract test methods for conformance testing of application protocol independent implementations of the Standard Data Access Interface (SDAI) - ISO 10303-22. 2 Normative references The f

28、ollowing normative documents contain provisions which, through reference in this text, constitute provisions of this part of ISO 10303. For dated references, subsequent amendments to, or revision of, any of these publications do not apply. However, parties to agreements based on this part of ISO 103

29、03 are encouraged to investigate the possibility of applying the most recent editions of the normative documents ISO 2001 All rights reservedISO 10303-34:2001(E) 2 indicated below. For undated references, the latest edition of the normative document referred to applies. Members of ISO and IEC mainta

30、in registers of currently valid International Standards. ISO 10303-1:1994, Industrial automation systems and integration - Product data representation and exchange - Part 1: Overview and fundamental principles. ISO 10303-11:1994, Industrial automation systems and integration - Product data represent

31、ation and exchange - Part 11: The EXPRESS language reference manual. ISO 10303-21:1994, Industrial automation systems and integration - Product data representation and exchange - Part 21: Implementation methods: Clear text encoding of the exchange structure. ISO 10303-22:1998, Industrial automation

32、systems and integration - Product data representation and exchange - Part 22: Implementation methods: Standard data access interface. ISO 10303-31:1994, Industrial automation systems and integration - Product data representation and exchange - Part 31: Conformance testing methodology and framework:

33、General concepts. ISO 10303-32:1998, Industrial automation systems and integration - Product data representation and exchange - Part 32: Conformance testing methodology and framework: Requirements on testing laboratories and clients. 3 Terms, definitions and abbreviations 3.1 Terms defined in ISO 10

34、303-1 For the purposes of this part of ISO 10303, the following terms defined in ISO 10303-1 apply. abstract test suite (ATS); application interpreted model; application protocol (AP); application reference model; conformance class; exchange structure; implementation method; Protocol Implementation

35、Conformance Statement (PICS); PICS proforma. 3.2 Terms defined in ISO 10303-11 For the purposes of this part of ISO 10303, the following terms defined in ISO 10303-11 apply. ISO 2001 All rights reservedISO 10303-34:2001(E) 3 entity; entity instance. 3.3 Terms defined in ISO 10303-22 For the purposes

36、 of this part of ISO 10303, the following terms defined in ISO 10303-22 apply. schema instance; SDAI model. 3.4 Terms defined in ISO 10303-31 For the purposes of this part of ISO 10303, the following terms defined in ISO 10303-31 apply. abstract test case (ATC); abstract test method; conformance; co

37、nformance log; conformance test report; conformance testing; executable test case; fail (verdict); implementation under test (IUT); inconclusive (verdict); pass (verdict); PIXIT (Protocol Implementation eXtra Information for Testing); PIXIT proforma; preprocessor; postprocessor; system under test (S

38、UT); test campaign; test case error; ISO 2001 All rights reservedISO 10303-34:2001(E) 4 testing laboratory; test report; test verdict; verdict criteria. 3.5 Other terms and definitions For the purposes of this part of ISO 10303, the following terms and definitions apply. 3.5.1 application element an

39、 application object, attribute, or assertion defining the information requirements in clause 4 of an application protocol. 3.5.2 semantic analysis the evaluation as to whether or not the information content of a schema instance was maintained during either preprocessing or postprocessing. 3.5.3 stru

40、cture analysis the evaluation as to whether or not an IUT schema instance conforms to the AIM and conformance requirements of the ISO 10303 application protocol of interest. 3.5.4 SUT operator a human or an automated component of the system under test that enables communication of instructions and q

41、uery data between the test engine and the implementation under test. 3.5.5 syntax analysis the evaluation as to whether or not an IUT schema instance is properly encoded in an exchange representation conforming to an implementation method of ISO 10303. 3.5.6 test case report a report covering the id

42、entifiers, data, results, and verdicts associated with the execution of a test case. 3.5.7 test case verdict a summarized verdict assigned to a test case derived from the individual verdicts assigned to the verdict criteria of a test case. 3.5.8 test engine the component of a test system that, by ob

43、serving test case instructions, prepares, controls, observes, and analyses an IUT. ISO 2001 All rights reservedISO 10303-34:2001(E) 5 3.5.9 test system the hardware, software, and data used by a testing laboratory to execute a test method. 3.6 Abbreviations For the purposes of this part of ISO 10303

44、, the following abbreviations apply. AE Application Element AP Application Protocol ATC Abstract Test Case ATS Abstract Test Suite ETC Executable Test Case IUT Implementation Under Test PICS Protocol Implementation Conformance Statement PIXIT Protocol Implementation eXtra Information for Testing SDA

45、I Standard Data Acess Interface SUT System Under Test 4 Overview and assumptions Two abstract test methods are defined in this part of ISO 10303. The first provides for testing of implementations that generate exchange structures, i.e., preprocessors. The second provides for testing of implementatio

46、ns that interpret exchange structures, i.e., postprocessors. These methods are defined in clauses 5 and 6 respectively. Both abstract test methods apply also to applications that interface with SDAI implementations in a data sharing environment. General principles and an overall framework for confor

47、mance testing are provided in ISO 10303-31. Requirements on test laboratories are defined in ISO 10303-32. The methods for preparing, controlling, observing, and analyzing implementations during testing are defined in this part of ISO 10303. Specific abstract test cases associated with ISO 10303 app

48、lication protocols are defined in corresponding ISO 10303 abstract test suite standards. A description of abstract test suites concepts and the requirements on their use are defined in each 10303 abstract test suite. 4.1 Components of exchange structure test methods Exchange structure test methods a

49、re based on three principal components: the implementation to be tested, a test system, and a human or automated component between them. These are the Implementation Under Test (IUT), the Test Engine, and the System Under Test Operator (SUT Operator), respectively. The Test Engine represents the control and communication functions of a test system, directing the execution and analysis o