ASTM E1499-1997(2009) Standard Guide for Selection Evaluation and Training of Observers《监测员挑选 评价和训练的标准指南》.pdf

1、Designation: E1499 97 (Reapproved 2009)Standard Guide forSelection, Evaluation, and Training of Observers1This standard is issued under the fixed designation E1499; the number immediately following the designation indicates the year oforiginal adoption or, in the case of revision, the year of last r

2、evision. A number in parentheses indicates the year of last reapproval. Asuperscript epsilon () indicates an editorial change since the last revision or reapproval.1. Scope1.1 This guide describes criteria and tests for selecting,evaluating, and training human visual-sensory observers fortasks invol

3、ving the perception and scaling of properties andphenomena relating to appearance.1.2 Examples of tests requiring the use of trained observersinclude but are not limited to those described in the followingASTM standards: on color, Practice D1535 and PracticeE1360; on color difference, Practice D1729

4、 and Test MethodD2616; on gloss, Test Method D4449; on metamerism, Prac-tice D4086; and on setting tolerances, Practice D3134.1.3 This standard does not purport to address all of thesafety concerns, if any, associated with its use. It is theresponsibility of the user of this standard to establish ap

5、pro-priate safety and health practices and determine the applica-bility of regulatory limitations prior to use.2. Referenced Documents2.1 ASTM Standards:2D1535 Practice for Specifying Color by the Munsell SystemD1729 Practice for Visual Appraisal of Colors and ColorDifferences of Diffusely-Illuminat

6、ed Opaque MaterialsD2616 Test Method for Evaluation of Visual Color Differ-ence With a Gray ScaleD3134 Practice for Establishing Color and Gloss TolerancesD4086 Practice for Visual Evaluation of MetamerismD4449 Test Method for Visual Evaluation of Gloss Differ-ences Between Surfaces of Similar Appea

7、ranceE284 Terminology of AppearanceE1360 Practice for Specifying Color by Using the OpticalSociety of America Uniform Color Scales System3. Terminology3.1 DefinitionsDefinitions of appearance terms in Termi-nology E284 are applicable to this guide.3.2 Definitions of Terms Specific to This Standard:3

8、.2.1 appearance, nin psychophysical studies, perceptionin which the spectral and geometric aspects of a visual stimulusare integrated with its illuminating and viewing environment.3.2.2 observer, none who judges visually, qualitatively orquantitatively, the content of one or more appearance attribut

9、esin each member of a set of objects or stimuli.3.2.3 scale, vto assess the content of one or more appear-ance attributes in the members of a set of stimuli.3.2.3.1 DiscussionAlternatively, scales may be deter-mined by assessing the difference in content of an attributewith respect to the difference

10、s in that attribute among themembers of the set.4. Summary of Guide4.1 This guide provides descriptions of techniques and testsfor the selection of candidates for observers for use in visualtesting, for the evaluation of their capabilities in this field, andfor their training to enhance these capabi

11、lities.4.2 Discussion is provided of precautions required for theefficient use of observers in visual tests, including avoidance ofovertaxing the observers and the control of test variables.4.3 Other considerations of test design, including the num-bers of observers and observations required and the

12、 precisionof the visual results, are to be covered elsewhere.5. Significance and Use5.1 The term appearance (see 3.2.1) implies the essentialpresence of human visual observations. The results of visualobservation involve not only the step of observing, accom-plished by the eye, but also the insepara

13、ble step of interpreta-tion in the brain. Instrumental test methods currently cannotduplicate this second step, and therefore can now only approxi-mate, but not fully measure, appearance. Such instrumentalmeasures of appearance properties are useful only to the extentthat they can be correlated to t

14、he results of visual observationsby observers of the appearance phenomena being evaluated.1This guide is under the jurisdiction of ASTM Committee E12 on Color andAppearance and is the direct responsibility of Subcommittee E12.11 on VisualMethods.Current edition approved Dec. 1, 2009. Published Decem

15、ber 2009. Originallyapproved in 1992. Last previous edition approved in 2003 as E1499 97 (2003).DOI: 10.1520/E1499-97R09.2For referenced ASTM standards, visit the ASTM website, www.astm.org, orcontact ASTM Customer Service at serviceastm.org. For Annual Book of ASTMStandards volume information, refe

16、r to the standards Document Summary page onthe ASTM website.1Copyright ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959, United States.5.2 Almost invariably, too little attention has been paid toensuring that the essential visual observations have beenproperly

17、 obtained to provide the basis for correlating visual andinstrumental test results. (The only recent book devoted tovisual measurements (1)3has no index entry for observer.)5.3 This guide provides the means for assessing observers,by outlining the requirements and tests for their selection,evaluatio

18、n, and training. This guide should be useful to allexperimenters designing or using visual test methods to pro-vide either direct results in terms of the observation ofappearance properties, or the experiments correlating suchresults with instrumental measures approximating the sameappearance proper

19、ties.6. Selection and Evaluation of Observers6.1 The process used for selecting observers depends a greatdeal upon the type of experiment being carried out, but shouldessentially evaluate the potential capability of the observer toexecute a series of visual evaluation tasks (2, 3). When thesetasks i

20、nvolve appearance attributes, color or related spectralphenomena are often among the task subjects, and if insteadgeometric phenomena such as gloss are involved, many of thesame considerations apply. Accordingly, the emphasis in thisguide is upon selecting observers for color-related measure-ments.

21、Thus, observers must be screened to rule out those withany color- or task-oriented deficiencies.6.2 Color Vision Tests (4):6.2.1 Pseudoisochromatic PlatesAs a preliminary colorvision test, a pseudoisochromatic-plate test4,5,6should beadministered to the candidate observers. The instructions andscori

22、ng techniques supplied by the manufacturer should befollowed. In particular, the illumination level should be keptwell within the photopic range (1000 1x is recommended as aminimum value) and the spectral quality of the illuminatingsource should be near that of north-sky daylight. Failure toidentify

23、 correctly the required number of the plates in the testused should be considered grounds for dismissing the candi-date observer.6.2.2 Color Rule TestWhen the anticipated experimentinvolves observing in the object mode, the candidate observershould be asked to find a (metameric) match on a Color Rul

24、e.5Astandard light source should be used, similar to that specifiedin the majority of tests for which the observer is being trained.It should be remembered that normal trichromats will reportmatch points that are dependent on age (5), but any abnormalmatch point should be considered grounds for dism

25、issing thecandidate observer.NOTE 1An abnormal match point may be considered one that fails tofall within the main groupings of observer match points for the lightsource used on either Fig. 3 of Ref (5) or the figure of Ref (6). Note,however, that this criterion is specific to the originalD see 6.3.

26、1.) In the Farnsworth-Munsell 100 HueTest, abnormal color vision is indicated by the observersfailure to place the test chips in correct order. The chips consistof 85 colored papers varying in hue at approximately constantvalue and chroma, and the observers failure is usually by widemargins in one o

27、r more limited regions of the hue circle. Thepresence of such abnormal results of the test should be groundsfor dismissing the candidate observer.6.3 Visual Acuity and Discrimination TestsHaving deter-mined that the candidate observers have normal color vision, itis next necessary to test their leve

28、l of discrimination of smalldifferences in color or another appearance attribute of interest.6.3.1 Farnsworth-Munsell 100 Hue TestUse of theFarnsworth-Munsell 100 Hue Test as a color-discriminationtest does not require readministration of the test, but merelyreexamination of the test results. For th

29、e purposes of assessingcolor (more precisely, hue) discrimination, the test results areexamined for the presence of an approximately constant butsignificant error level in the arrangement of the test chipsthroughout the hue circle. This may be interpreted as aninability to discriminate the small col

30、or differences betweenneighboring chips. While a weakness of this type might, forexample, interfere with an observers ability to participate inthreshold scaling experiments, the observer might still becompetent to perform magnitude scaling of larger differencesamong specimens.6.3.2 Triangle TestThis

31、 test is part of a series known asthe Japanese Color Aptitude Test.5,9The candidate observersare shown, one at a time, a series of 20 sets of three coloredchips each. In each set, two of the chips are identical and thethird is slightly different in color. The observer is asked toidentify which one i

32、s different, the differences being so smallthat there is considerable uncertainty in the judgment. A lowerthan average score in this test indicates that the observer doesnot differentiate small differences well.3The boldface numbers in parentheses refer to the list of references at the end ofthis st

33、andard.4The sole source of supply of the Dvorine Pseudo-Isochromatic Plates, knownto the committee at this time is The Psychological Corp., Harcourt BraceJovanovich, 555 Academic Court, San Antonio, TX 78204.5If you are aware of alternative suppliers, please provide this information toASTM Internati

34、onal Headquarters. Your comments will receive careful consider-ation at a meeting of the responsible technical committee,1which you may attend.6The sole source of supply of the H-R-R Pseudoisochromatic plates, IshiharaColor-Blindness Tests, known to the committee at this time is Richmond ProductsInc

35、., 1021 S. Rogers Circle, Suite 6, Boco Raton, FL 33484.7D MatchPoint Rule (available 1990 butnot equivalent to the D the nature and level of theillumination; the nature and luminance of the surround; and theabsence of any distraction in the observers field of vision, suchas light reflected from glo

36、ssy surfaces or brightly coloredclothing.10The sole source of supply of the HVC Color Vision Skill Test, known to thecommittee at this time is Lou Graham and Associates, Inc., 1207 Colonial Ave.,Greensboro, NC 27408.E1499 97 (2009)38.2.1 The optimum levels of illumination for the judgmentof surface

37、colors given in Practice D1729 are far above thosethat can be obtained with video display units and similardevices. This unavoidable difference must be properly takeninto account in the design of the experiments in whichjudgments of colors and color differences generated on suchdisplays are required

38、.8.3 It is well known (13) that the visual judgment of colordifferences is affected if the state of adaptation of the observ-ers eyes is changed, since the sensitivity of the eye to colordifferences decreases for the colors corresponding to theadapting color. On examination of a color-difference pai

39、r undernormal conditions (unless the pair specimens are unusuallysmall) their mean color is the adapting color, and prolongedviewing can lead to adaptation to that color and a decrease insensitivity to the color difference. It is therefore usual to viewsmall color differences in quick glances, as th

40、ey tend to appearless prominent on prolonged viewing.8.4 In the report noted (10), it was also pointed out that thedifferences among stimuli to be scaled can be too large as wellas too small. There appears to be an upper limit to the size ofdifferences that the human visual system can scale, as well

41、 asa threshold, as is well known.9. Precision and Bias9.1 Matters leading to estimations of the precision and biasof visual measurements will depend strongly on the experi-mental design to be used, but should be explored and consid-ered as an integral part of establishing that design. References(1-1

42、2) provide few examples in which this has been done.10. Keywords10.1 appearance; observers; training; visualexamination-colorREFERENCES(1) Bartleson, C. J., and Grum, F., eds.,“Visual Measurements,” Vol 5 inGrum, F., and Bartleson, C. J., eds., Optical Radiation Measurements,Academic Press, New York

43、, NY, 1984.(2) Taylor, J. M., and Billmeyer, F. W., Jr., “Multidimensional Scaling ofSelected Samples from the Optical Society of America Uniform ColorScales,” Color Research and Application, Vol 13, 1988, pp. 8598.(3) Billmeyer, F. W., Jr., and ODonnell, F. X. D.,“Visual Gloss Scalingand Multidimen

44、sional Scaling Analysis of Painted Specimens,” ColorResearch and Application, Vol 12, 1987, pp. 315326.(4) Procedures for Testing Color Vision, Document No. ADA 113680,National Technical Information Service, U.S. Department of Com-merce, Springfield, VA, 1981.(5) Kaiser, P. K., and Hemmendinger, H.,

45、 “The Color Rule, a Device forColor Vision Testing,” Color Research and Application, Vol 5, 1980,pp. 6571.(6) Billmeyer, F. W., Jr., and Saltzman, M., “Observer Metamerism,”Color Research and Application, Vol 5, 1980, p. 72.(7) Farnsworth, D., “The Farnsworth-Munsell 100 Hue and DichotomousTests for

46、 Color Vision,” Journal of the Optical Society of America,Vol33, 1943, pp. 568578.(8) Lodge, M., “Magnitude Scaling: Quantitative Measurement of Opin-ions,” Sage, Beverly Hills, CA, 1981, p. 9.(9) Strocka, D., Brockes, A., and Paffhausen, W., “Influence of Experi-mental Parameters in the Evaluation

47、of Color-Difference Ellipsoids,”Color Research and Application, Vol 8, 1983, pp. 169175.(10) Billmeyer, F. W., Jr., “1989 ISCC Williamsburg Conference on ColorDiscrimination Psychophysics,” ISCC Technical Report 90-1, ISCC,Princeton, NJ, 1990.(11) Manual on Sensory Testing Methods, ASTM STP 434, AST

48、M,1968, Section I B.(12) Witt, K., “Three-Dimensional Threshold of Color-Difference Percep-tibility in Painted Samples: Variability of Observers in Four CIERegions,” Color Research and Application, Vol 12, 1987, pp.128134.(13) Evans, R. M., “An Introduction to Color,” Wiley, New York, NY,1948, p. 22

49、3.ASTM International takes no position respecting the validity of any patent rights asserted in connection with any item mentionedin this standard. Users of this standard are expressly advised that determination of the validity of any such patent rights, and the riskof infringement of such rights, are entirely their own responsibility.This standard is subject to revision at any time by the responsible technical committee and must be reviewed every five years andif not revised, either reapproved or withdrawn. Your comments are invited either for revision of thi