ISO 10303-31-1994 Industrial automation systems and integration - Product data representation and exchange - Part 31 Conformance testing methodology and framewo.pdf

1、INTERNATIONAL STANDARD IS0 10303-31 First edition 1994-I 2-l 5 Industrial automation systems and integration - Product data representation and exchange - Part 31: Conformance testing methodology and framework: General concepts SystGmes dautomatisation industrielle et int6gration - Reprksentation et

2、change de don certificate of conformance . certification body . certification mark . certification of conformity . certification system client (of a testing laboratory) comparability (of results) . conformance conformance assessment process . conformance log conformance testing (conformance) test re

3、port . 3 4 4 4 4 4 4 5 5 5 5 5 5 5 5 5 5 5 6 6 6 6 6 6 6 6 6 All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from the

4、publisher. International Organization for Standardization Case Postale 56 l CH-1211 Genke 20 l Switzerland Printed in Switzerland ii 0 c IS0 IS0 10303-31:1994(E) 3.2.24 conforming implementation . 6 3.2.25 conformity; conformance 6 3.2.26 control board 6 3.2.27 declaration of conformance 6 3.2.28 de

5、claration of conformity; (manufacturers) declaration of conformance . 7 3.2.29 executable test case 7 3.2.30 executable test suite 7 3.2.31 fail (verdict) 7 3.2.32 falsification testing . 7 3.2.33 Implementation Under Test (IUT) 7 3.2.34 inconclusive (verdict) . 7 3.2.35 in-house testing 7 3.2.36 ma

6、nufacturers declaration of conformance . 7 3.2.37 non-conformance 7 3.2.38 non-conformity; non-conformance . 7 3.2.39 pass (verdict) 7 3.2.40 PIXIT proforma 8 3.2.41 postprocessor 8 3.2.42 preprocessor 8 3.2.43 proficiency testing . 8 3.2.44 Protocol Implementation extra Information for Testing (PIX

7、IT) . 8 3.2.45 repeatability (of results) 8 3.2.46 resolution tests . 8 3.2.47 selected abstract test suite 8 3.2.48 selected executable test suite . 8 3.2.49 System Under Test (SUT) . 8 3.2.50 test campaign. . 8 3.2.51 testcase . 8 3.2.52 test case error . 8 3.2.53 test purpose 9 3.2.54 test realis

8、er . 9 3.2.55 test report . 9 3.2.56 test verdict . 9 3.2.57 testing laboratory . 9 3.2.58 (test) verdict 9 3.2.59 verdict criteria . 9 3.2.60 verification testing . 9 4 Abbreviations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 Conformance . . . . . . . . . . . . . . . . . . . . . .

9、. . . . . . . 5.1 The meaning of conformance in IS0 10303 . . . . . . . . 5.2 Conformance requirements . . , I . . _ . . . . . . I . . . 5.3 Protocol Implementation Conformance Statement . . . . . 5.4 A conforming system . . . . . . . . . . . . . . . . . . . . . 6 Conformance testing . . . . . . . .

10、 . . . . . . . . . . . . . . . . . 9 10 10 10 LO 11 11 . . . 111 IS0 10303-31:1994(E) 0 c IS0 6.1 Introduction . 11 6.2 Types of conformance tests . 11 6.2.1 Basic tests . 12 6.2.2 Capability tests 12 6.3 Protocol Implementation extra Information for Testing . 13 6.4 Conformance assessment process o

11、verview . 13 6.5 Preparation for testing 14 6.6 Test campaign 16 6.7 Analysis of results 16 6.8 Conformance test report production 16 6.9 Intrinsic properties of the conformance assessment process 17 6.9.1 Repeatability of results 17 6.9.2 Comparability of results 17 6.9.3 Auditability of results .

12、17 7 Abstract test methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 8 Abstract and executable test suites . 18 8.1 Structure . 18 8.2 Test purposes . 18 8.3 Abstract test cases 18 8.4 Executable test cases . 20 8.5 Relationship between abstract and executable test c

13、ases . 20 Annexes A Information object registration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 B Optional conformance requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 C Resolution tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

14、 . . 23 D Supporting organisations . 24 D.l Introduction . 24 D.l.l Purpose . 24 D.1.2 Scope 24 D.1.3 Intended readership 24 D.1.4 Background . 25 D.1.5 General philosophy of conformance testing . 25 D.2 Responsible authorities . 25 D.2.1 Control board . 25 D.2.2 Accreditation body . 28 D.2.3 Testin

15、g laboratory . 28 D.2.4 Certification body . n . f . I . I I . , , I . ” I I ” , I . . _ I I I I , . 29 D.3 Administration and certification 30 D.3.1 Guidelines for role of the certification body . 30 D.3.2 Sponsoring a laboratory accreditation programme . 30 iv 0 c IS0 IS0 10303-31:1994(E) D.3.3 Co

16、nditions for testing laboratory accreditation D.3.4 Criteria for a,ccrediting testing laboratories D.3.5 Testing laboratory assessment . D.4 The process of certification D.4.1 Initial contact D.4.2 Certificate of conformity content and presentation D.4.3 National responsibilities . D.4.4 Internation

17、al (IS0 TC184/SC4) responsibilities 31 31 32 34 34 34 35 35 E Bibliography . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38 Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39 Figures 1 Relationship between conforma

18、nce testing standards and other series of parts 2 2 Overview of the conformance assessment process 15 3 Example structure of an abstract test suite . 19 D.1 Infrastructure for conformance testing 26 D.2 Sample certificate of conformity 36 D.3 Sample form for additional claims made by the client 37 V

19、 IS0 1030%31:1994(E) ISO Foreword The International Organization for Standardization (ISO) is a worldwide federation of national standards bodies (IS0 member bodies). The work of preparing International Standards is nor- mally carried out through IS0 technical committees. Each member body interested

20、 in a subject for which a technical committee has been established has the right to be represented on that committee. International organizations, governmental and nongovernmental, in liaison with ISO, also take part in the work. IS0 collaborates closely with the Int.ernational Electrotechnical Comm

21、ission (IEC) on all matters of electrotechnical standardization. Draft International Standards adopted by technical committees are circulated to the member bodies for voting. Publication as an International Standard requires approval by at least 75% of the member bodies casting a vote. International

22、 Standard IS0 10303-31 was prepared by Technical Committee ISO/TC 184, In- dustrial uutomotion systems and integration, Subcommittee SCX, Industrial data and globwl manufacturing programming languages. IS0 10303 consists of the following parts under the general title Industrial automation systems an

23、d integration - Product data representation and exchange: - Part 1, Overview and fundamental principles; - Part 11, Description methods: The EXPRESS language reference manual; - Part 21, Implementation methods: Clear text encoding of the exchange structure; - Part 22, Implementation methods: Standar

24、d data access interface specification; - Part 31, Conformance testing methodology and framework: General concepts; - Part 32, Conformance testing methodology and framework: Requirements on testing laboratories and clients: - Part 41, Integrated generic resources: Fundamentals of product description

25、and support; - Part 42, Integrated generic resources: Geometric and topological representation; - Part 43, Integrated generic resources: Representation structures; - Part 44, Integrated generic resources: Product structure configuration; - Part 45, Integrated generic resources: Materials; - Part 46,

26、 Integrated generic resources: Visual presentation; - Part 47, Integrated generic resources: Shape variation tolerances; - Part 49, Integrated generic resources: Process structure and properties; vi 0 c IS0 IS0 10303-31:1994(E) - Part 101, Integrated application resources: Draughting; - Part 104, In

27、tegrated application resources: Finite element analysis; - Part 105, Integrated application resources: Kinematics; - Part 201, Application protocol: Explicit draughting; - Part 202, Application protocol: Associative draughting; _- Part 203, Application protocol: Configuration controlled design; - Pa

28、rt 207, Application protocol: Sheet metal die planning and design; - Part 210, Application protocol: Printed circuit assembly product design data; - Part 213, Application protocol: Numerical control process plans for machined parts. The structure of this International Standard is described in IS0 10

29、303-l. The numbering of the parts of this International Standard reflects its st,ructure: - Part 11 specifies the description methods; - Parts 21 and 22 specify the implementation methods; - Parts 31 and 32 specify the conformance testing methodology and framework; - Parts 41 to 49 specify the integ

30、rated generic resources; - Parts 101 to 105 specify t,he integrated application resources; - Parts 201 to 213 specify the application protocols. Should further parts be published, they will follow the same numbering pattern. Annex A forms an integral part of this part of IS0 10303. Annexes B, C, D,

31、and E are for information only. vii IS0 10303-31:1994(E) 0 c IS0 Introduction IS0 10303 is an International Standard for the computer-interpretable representation and ex- change of product data. The objective is to provide a neutral mechanism capable of describing product data throughout the life cy

32、cle of a product independent from any particular system. The nature of this description makes it suitable not only for neutral file exchange, but also as a basis for implementing and sharing product databases and archiving. This International Standard is organized as a series of parts, each publishe

33、d separately. The parts of IS0 10303 fall into one of the following series: description methods, integrated resources, application protocols, abstract test suites, implementation methods, and conformance testing. The series are described in IS0 10303-l. This part of IS0 10303 is a member of the conf

34、ormance testing series. This part of IS0 10303 introduces the series of parts of IS0 10303 devoted to conformance test- ing, provides a framework and describes the general concepts for conformance testing of imple- mentations of IS0 10303. This part of IS0 10303 is based in part upon material in IS0

35、 9646-l which provides the same function for conformance testing in Open Systems Interconnection. The concepts have been modified for use in this particular domain. This part therefore plays a similar role for this series of parts as does IS0 9646-l for IS0 9646. Subsequent parts con- cerning confor

36、mance testing of implementations of IS0 10303 are also based upon subsequent parts of IS0 9646. IS0 10303-31 applies not only to exchange structures but, with the current knowledge available, to other implementation methods also. Subsequent parts required for the establishment of conformance testing

37、 services address: - requirements on testing laboratories and clients (IS0 10303-32); - abstract test suites (IS0 10303-33); - abstract test methods (IS0 10303-34). This part also incorporates aspects from the development of the IS0 9000 and EN 45000 series of standards and from a number of ISO/IEC

38、guides: a) ISO/IEC Guide 2: C Teneral terms and their definitions concerning standardization and related activities; b) ISO/IEC Guide 25: G eneral requirements for the competence of calibration and testing laboratories; 4 ISO/IEC Guide 38: General requirements for the acceptance of testing laborator

39、ies; d) ISO/IEC Guide 40: General requirements for the acceptance of certification bodies; e) ISO/IEC Guide 42: Guidelines for a step-by-step approach to an international certifi- cation system; f) ISO/IEC Guide 43: Development and operation of laboratory proficiency testing; . . . VII1 0 c IS0 IS0

40、10303-31:1994(E) g ISO/IEC Guide 45: Guidelines for the presentation of test results. The objective of product, data exchange cannot be completely achieved unless systems can be tested to determine whether they conform to the relevant product data exchange standards. There is an industrial need to e

41、stablish conformance testing services for implementations of IS0 10303. This part of IS0 10303 provides a foundation for the subsequent parts in this series which are required to establish conformance testing services and hence, meet that industrial need. Conformance testing is a type of testing def

42、ined as the testing of a candidate product for the existence of specific characteristics required by a standard in order to determine the extent to which that product is a conforming implementation. It involves testing the capabilities of an implementation against both the conformance requirements i

43、n the relevant standard(s) and what the client states the implementations capabilities are. An abstract test suite is standardised for each application protocol of IS0 10303, for use by suppliers or implementors in self-testing, by users of product data exchange products, or by other third party tes

44、ting organisations. This should lead to comparability and wide acceptance of test reports produced by different testing laboratories, and thereby minimise the need for repeated conformance testing of the same system. The standardisation of abstract test suites requires international definition and a

45、cceptance of a common test methodology, together with appropriate test methods and procedures. It is the purpose of this series of parts to define the methodology, to provide a framework for specifying abstract test suites, and to define the procedures to be followed during conformance testing. Deta

46、ils of test methods are addressed in this series of parts; however, any organisation con- templating the use of test methods defined in this series of parts should carefully consider the constraints on their applicability. Conformance testing does not include some types of testing which may be appro

47、priate for imple- mentations of IS0 10303. These include robustness testing, interoperability testing, acceptance testing and performance testing. These test methods do not form part of conformance test- ing because there are no appropriate conformance requirements in the standard against which to t

48、est. After the results from conformance testing are available, additional testing may be performed. Conformance testing does not provide judgements on how a system is implemented, how reliable it is, how it provides any requested service, nor the environment of the implementation. It does not, excep

49、t in an indirect way, prove anything about the logical design of the standard itself. Conformance is not sufficient to guarantee interoperability; however, it increases the probability that different implementations are able to interoperate. In order to be able to interoperate, it is necessary that two implementations that conform to a given application protocol support compatible options within that application protocol. The complexity of most standards makes exhaustive testing impractical on both technical and economic grounds. For this same reason of complexity, proof of correctne