ASTM D6708-2018 red 7500 Standard Practice for Statistical Assessment and Improvement of Expected Agreement Between Two Test Methods that Purport to Measure the Same Property of a .pdf

1、Designation: D6708 16bD6708 18 An American National StandardStandard Practice forStatistical Assessment and Improvement of ExpectedAgreement Between Two Test Methods that Purport toMeasure the Same Property of a Material1This standard is issued under the fixed designation D6708; the number immediate

2、ly following the designation indicates the year oforiginal adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. Asuperscript epsilon () indicates an editorial change since the last revision or reapproval.1. Scope*1.1 This pra

3、ctice covers statistical methodology for assessing the expected agreement between two standard test methods thatpurport to measure the same property of a material, and deciding if a simple linear bias correction can further improve the expectedagreement. It is intended for use with results collected

4、 from an interlaboratory study meeting the requirement of Practice D6300or equivalent (for example, ISO 4259). The interlaboratory study must be conducted on at least ten materials that span theintersecting scopes of the test methods, and results must be obtained from at least six laboratories using

5、 each method.1.2 The statistical methodology is based on the premise that a bias correction will not be needed. In the absence of strongstatistical evidence that a bias correction would result in better agreement between the two methods, a bias correction is not made.If a bias correction is required

6、, then the parsimony principle is followed whereby a simple correction is to be favored over a morecomplex one.NOTE 1Failure to adhere to the parsimony principle generally results in models that are over-fitted and do not perform well in practice.1.3 The bias corrections of this practice are limited

7、 to a constant correction, proportional correction or a linear (proportional +constant) correction.1.4 The bias-correction methods of this practice are method symmetric, in the sense that equivalent corrections are obtainedregardless of which method is bias-corrected to match the other.1.5 A methodo

8、logy is presented for establishing the 95 % confidence limit (designated by this practice as the between methodsreproducibility) for the difference between two results where each result is obtained by a different operator using different apparatusand each applying one of the two methods X and Y on i

9、dentical material, where one of the methods has been appropriatelybias-corrected in accordance with this practice.NOTE 2In earlier versions of this standard practice, the term “cross-method reproducibility” was used in place of the term “between methodsreproducibility.” The change was made because t

10、he “between methods reproducibility” term is more intuitive and less confusing. It is important to notethat these two terms are synonymous and interchangeable with one another, especially in cases where the “cross-method reproducibility” term wassubsequently referenced by name in methods where a D67

11、08 assessment was performed, before the change in terminology in this standard practice wasadopted.NOTE 3Users are cautioned against applying the between methods reproducibility as calculated from this practice to materials that are significantlydifferent in composition from those actually studied,

12、as the ability of this practice to detect and address sample-specific biases (see 6.8) is dependent onthe materials selected for the interlaboratory study. When sample-specific biases are present, the types and ranges of samples may need to be expandedsignificantly from the minimum of ten as specifi

13、ed in this practice in order to obtain a more comprehensive and reliable 95 % confidence limits forbetween methods reproducibility that adequately cover the range of sample specific biases for different types of materials.1.6 This practice is intended for test methods which measure quantitative (num

14、erical) properties of petroleum or petroleumproducts.1.7 The statistical methodology outlined in this practice is also applicable for assessing the expected agreement between anytwo test methods that purport to measure the same property of a material, provided the results are obtained on the same co

15、mparisonsample set, the standard error associated with each test result is known, and the sample set design meets the requirements of thispractice, in particular that the statistical degree of freedom associated with all standard errors are 30 or greater.1 This practice is under the jurisdiction of

16、ASTM Committee D02 on Petroleum Products, Liquid Fuels, and Lubricants and is the direct responsibility of SubcommitteeD02.94 on Coordinating Subcommittee on Quality Assurance and Statistics.Current edition approved June 15, 2016April 1, 2018. Published August 2016July 2018. Originally approved in 2

17、001. Last previous edition approved in 2016 asD6708 16a.D6708 16b. DOI: 10.1520/D6708-16B.10.1520/D6708-18.This document is not an ASTM standard and is intended only to provide the user of an ASTM standard an indication of what changes have been made to the previous version. Becauseit may not be tec

18、hnically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current versionof the standard as published by ASTM is to be considered the official document.*A Summary of Changes section appears at the end of thi

19、s standardCopyright ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States11.8 This international standard was developed in accordance with internationally recognized principles on standardizationestablished in the Decision on Principles for the Devel

20、opment of International Standards, Guides and Recommendations issuedby the World Trade Organization Technical Barriers to Trade (TBT) Committee.2. Referenced Documents2.1 ASTM Standards:2D5580 Test Method for Determination of Benzene, Toluene, Ethylbenzene, p/m-Xylene, o-Xylene, C9 and Heavier Aroma

21、tics,and Total Aromatics in Finished Gasoline by Gas ChromatographyD5769 Test Method for Determination of Benzene, Toluene, and Total Aromatics in Finished Gasolines by GasChromatography/Mass SpectrometryD6299 Practice for Applying Statistical Quality Assurance and Control Charting Techniques to Eva

22、luate Analytical Measure-ment System PerformanceD6300 Practice for Determination of Precision and Bias Data for Use in Test Methods for Petroleum Products and LubricantsD7372 Guide for Analysis and Interpretation of Proficiency Test Program Results2.2 ISO Standard:3ISO 4259 Petroleum ProductsDetermi

23、nation and application of precision data in relation to methods of test.3. Terminology3.1 Definitions:3.1.1 between ILCP method-averages reproducibility (RILCP_ X, ILCP_Y), na quantitative expression of the random errorassociated with the difference between the bias-corrected ILCP average of method

24、X versus the ILCP average of method Y froma Proficiency Testing program, when the method X has been assessed versus methodY, and an appropriate bias-correction has beenapplied to all method X results in accordance with this practice; it is defined as the 95 % confidence limit for the difference betw

25、eentwo such averages.3.1.2 between-method bias, na quantitative expression for the mathematical correction that can statistically improve thedegree of agreement between the expected values of two test methods which purport to measure the same property.3.1.3 between methods reproducibility (RXY),na q

26、uantitative expression of the random error associated with the differencebetween two results obtained by different operators using different apparatus and applying the two methods X and Y, respectively,each obtaining a single result on an identical test sample, when the methods have been assessed an

27、d an appropriate bias-correctionhas been applied in accordance with this practice; it is defined as the 95 % confidence limit for the difference between two suchsingle and independent results.3.1.3.1 DiscussionA statement of between methods reproducibility must include a description of any bias corr

28、ection used in accordance with thispractice.3.1.3.2 DiscussionBetween methods reproducibility is a meaningful concept only if there are no statistically observable sample-specific relativebiases between the two methods, or if such biases vary from one sample to another in such a way that they may be

29、 consideredrandom effects. (see 6.7.)3.1.4 closenesscentered sum of squares (CSS), na statistic used to quantify the degree of agreement between the results fromtwo test methods after bias-correction using the methodology of this practice.3.1.5 Interlaboratory Crosscheck Program (ILCP), nASTM Intern

30、ational Proficiency Test Program sponsored by CommitteeD02 on Petroleum Products, Liquid Fuels, and Lubricants; see ASTM website for current details. D73723.1.6 total sum of squares (TSS), na statistic used to quantify the information content from the inter-laboratory study in termsof total variatio

31、n of sample means relative to the standard error of each sample mean.3.2 Symbols:X,Y = single X-method and Y-method results, respectively2 For referencedASTM standards, visit theASTM website, www.astm.org, or contactASTM Customer Service at serviceastm.org. For Annual Book of ASTM Standardsvolume in

32、formation, refer to the standards Document Summary page on the ASTM website.3 Available from American National Standards Institute (ANSI), 25 W. 43rd St., 4th Floor, New York, NY 10036.D6708 182Xijk, Yijk = single results from the X-method and Y-method round robins, respectivelyXi, Yi = means of res

33、ults on the ith round robin sampleXI, Yi = means of results on the ith round robin sampleS = the number of samples in the round robinLXi, LYi = the numbers of laboratories that returned results on the ith round robin sampleRX, RY = the reproducibilities of the X- and Y- methods, respectivelyRXi, RYi

34、 = the reproducibility of method X and Y, evaluated at the method X and Y means of the ith round robin sample,respectivelyRILCP_ X, ILCP_Y = estimate of between ILCP method-averages reproducibilitysRXi, sRYi = the reproducibility standard deviations, evaluated at the method X and Y means of the i th

35、 round robin samplesrXi, srYi = the repeatability standard deviations, evaluated at the method X and Y means of the ith round robin samplesXi, sYi = standard errors of the means ith round robin sampleX, Y = the weighted means of round robins (across samples)xi, yi = deviations of the means of the it

36、h round robin sample results from X and Y, respectively.TSSX, TSSY = total sums of squares, around X and YF = a ratio for comparing variances; not uniquemore than one usevX, vY = the degrees of freedom for reproducibility variances from the round robinswi = weight associated with the difference betw

37、een mean results (or corrected mean results) from the ith roundrobin sampleCSS = centered sum of squares, weighted sum of squared differences between (possibly corrected) mean results fromthe round robina,b = parameters of a linear correction: Y = a + bXt1, t2 = ratios for assessing reductions in su

38、ms of squaresRXY = estimate of between methods reproducibilityY = predicted Y-method value for a sample by applying the bias correction established from this practice to anactual X-method result for the same sampleYi = predicted ith round robin sample Y-method mean, by applying the bias correction e

39、stablished from thispractice to its corresponding X-method meani = standardized difference between Yi and Yi.LX, LY = harmonic mean numbers of laboratories submitting results on round robin samples, by X- and Y- methods,respectivelyRX Y = estimate of between methods reproducibility, computed from an

40、 X-method result only4. Summary of Practice4.1 Precisions of the two methods are quantified using inter-laboratory studies meeting the requirements of Practice D6300 orequivalent, using at least ten samples in common that span the intersecting scopes of the methods. The arithmetic means of theresult

41、s for each common sample obtained by each method are calculated. Estimates of the standard errors of these means arecomputed.NOTE 4For established standard test methods, new precision studies generally will be required in order to meet the common sample requirement.NOTE 5Both test methods do not nee

42、d to be run by the same laboratory. If they are, care should be taken to ensure the independent test resultrequirement of Practice D6300 is met (for example, by double-blind testing of samples in random order).4.2 Weighted sums of squares are computed for the total variation of the mean results acro

43、ss all common samples for eachmethod. These sums of squares are assessed against the standard errors of the mean results for each method to ensure that thesamples are sufficiently varied before continuing with the practice.4.3 The closeness of agreement of the mean results by each method is evaluate

44、d using appropriate weighted sums of squareddifferences. Such sums of squares are computed from the data first with no bias correction, then with a constant bias correction,then, when appropriate, with a proportional correction, and finally with a linear (proportional + constant) correction.4.4 The

45、weighted sums of squared differences for the linear correction is assessed against the total variation in the mean resultsfor both methods to ensure that there is sufficient correlation between the two methods.4.5 The most parsimonious bias correction is selected.4.6 The weighted sum of squares of d

46、ifferences, after applying the selected bias correction, is assessed to determine whetheradditional unexplained sources of variation remain in the residual (that is, the individual Yi minus bias-corrected Xi) data. Anyremaining, unexplained variation is attributed to sample-specific biases (also kno

47、wn as method-material interactions, or matrixeffects). In the absence of sample-specific biases, the between methods reproducibility is estimated.4.7 If sample-specific biases are present, the residuals (that is, the individual Yi minus bias-corrected Xi) are tested forrandomness. If they are found

48、to be consistent with a random-effects model, then their contribution to the between methodsreproducibility is estimated, and accumulated into an all-encompassing between methods reproducibility estimate.D6708 1834.8 Refer to Fig. 1 for a simplified flow diagram of the process described in this prac

49、tice.5. Significance and Use5.1 This practice can be used to determine if a constant, proportional, or linear bias correction can improve the degree ofagreement between two methods that purport to measure the same property of a material.5.2 The bias correction developed in this practice can be applied to a single result (X) obtained from one test method (methodX) to obtain a predicted result (Y) for the other test method (method Y).NOTE 6Users are cautioned to ensure that Y is within the scope of method Y before its use.5.3 The between methods r