ASTM E1958-2018 Standard Guide for Sensory Claim Substantiation.pdf

1、Designation: E1958 18Standard Guide forSensory Claim Substantiation1This standard is issued under the fixed designation E1958; the number immediately following the designation indicates the year oforiginal adoption or, in the case of revision, the year of last revision. A number in parentheses indic

2、ates the year of last reapproval. Asuperscript epsilon () indicates an editorial change since the last revision or reapproval.INTRODUCTIONFormats or standards for testing related to sensory claim substantiation cannot be consideredwithout a frame of reference of where that format or standard would f

3、it within the legal frameworkthat surrounds the topic. Product sensory claims tests are performed for three basic reasons: (1)Comparison of ProductsDetermines how one product compares to another, usually a competitor orearlier version of itself. (2) Substantiation of ClaimsEnables marketing personne

4、l to use positivereferences through advertising or packaging, or both, in the presentation of the product to theconsumer. (3) Test PerformanceAscertains and establishes the tested product performance withinthe scope of its intended use.The risk associated with each claim is assessed when considering

5、 claims substantiation. Compellingand aggressive claims are sure to be scrutinized closely by competitive firms, and if inconsistenciesare found through competitive test data, the claims could be challenged in one or more of thefollowing venues: (1) National Advertising Division (NAD) of the Adverti

6、sing Self-RegulatoryCouncil (ASRC), (2) one or more media, such as print, broadcast, or electronic media, (3) ConsumerAdvocacy Organizations, and (4) Civil or Federal courts. No single test design or standard test willprevent challenges. The criteria used by each of the potential forums are not iden

7、tical and areconstantly evolving. With the introduction of new technologies coupled with changing consumerdemands, testing processes and protocols that were sufficient five or ten years ago may not hold upunder todays criteria and scrutiny. Testing requirements of the future can only be a matter for

8、speculation. The one constant is that, as advocates of their clientspositions, attorneys will defend theirclients testing processes and protocol while questioning with great detail every aspect of theircompetitors protocol in the attempt to sway the arbiter to agree that their clients are in the rig

9、ht. Legalcounsel should be part of any team developing claim substantiation.This guide demonstrates what a group of professionals who are skilled in the science of testingconsider appropriate from a scientific and technical standpoint, and represents an effective method forboth defendant and challen

10、ger to determine the viability of a sensory claim. The key word is“appropriate.” If a particular aspect of a test, or method, is not appropriate for a specific application,it should not be used. Care should be taken to clearly define the reasons and data supporting adeviation from the standard, as a

11、ny departure invites scrutiny. Since departures are inevitable, theword “should” is used in this guide to indicate when other techniques may have applications in certainunusual circumstances. Whenever a test protocol has been completed, it should be critiqued forweaknesses, including whether experts

12、 in the relevant field would consider the research objectivelydesigned, conducted, and analyzed, using procedures that give accurate and reliable results. Ifweaknesses are found, corrective action should be taken, since the competition may point out anyweakness or discrepancy and challenge the study

13、.While the scientific and technical community identifies the appropriateness of a research methodused to support a sensory claim, the legal community evaluates substantiation for legal claims using“reasonableness” as the criterion. With the importance of having a legal “reasonable basis” for a claim

14、,the question remains, “What is reasonable?” Unfortunately, there is no specific answer to that legalquestion, as it will depend on the type of claim, product application and use, applicable regulationswhere the product is sold, and other factors. These considerations, market pressures (such as timi

15、ng),and testing budgets can influence and impact the protocols to support a specific claim. This guideprovides principles and considerations that need to be addressed for good sensory and consumertesting practices.Copyright ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, P

16、A 19428-2959. United StatesThis international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for theDevelopment of International Standards, Guides and Recommendations issued by the World Trade Organization

17、Technical Barriers to Trade (TBT) Committee.11. Scope1.1 This guide covers reasonable practices for designing andimplementing sensory tests that validate claims pertaining onlyto the sensory or perceptual attributes, or both, of a product.This guide was developed for use in the United States and mus

18、tbe adapted to the laws and regulations for advertisement claimsubstantiation for any other country. A claim is a statementabout a product that highlights its advantages, sensory orperceptual attributes, or product changes or differences com-pared to other products in order to enhance its marketabil

19、ity.Attribute, performance, and hedonic claims, both comparativeand non-comparative, are covered. This guide includes broadprinciples covering selecting and recruiting representativeconsumer samples, selecting and preparing products, construct-ing product rating forms, test execution, and statistica

20、l han-dling of data. The objective of this guide is to disseminate goodsensory and consumer testing practices. Validation of claimsshould be made more defendable if the essence of this guide isfollowed.Table of ContentsSectionIntroductionScope 1Referenced Documents 2Terminology 3Basis of Claim Class

21、ification 4Consumer Based Affective Testing 5Sampling 5.1Sampling Techniques 5.2Selection of Products 5.3Sampling of Products When Both Products Are Currently onthe Market5.4Handling of Products When Both Products Are Currently onthe Market5.5Sampling of Products Not Yet on the Market 5.6Sample Prep

22、aration/Test Protocol 5.7Test DesignConsumer Testing 6Data Collection Strategies 6.6Interviewing Techniques 6.7Type of Questions 6.8Questionnaire Design 6.9Instruction to Respondents 6.10Instructions to Interviewers 6.11General/Overall Questions 6.12Positioning of the Key Product Rating Questions 6.

23、13Total Test Context and Presentation Matters 6.14Specific Attribute Questions 6.15Classification or Demographic Questions 6.16Preference Questions 6.17Test Location 7Test Execution by Way of Test AgenciesFood and Non-FoodTesting8Documents to Retain in Sensory Claims Substantiation Research 9Laborat

24、ory Testing Methods 10Types of Tests 10.2Advantages and Limitations of the Use of Trained DescriptivePanels in Claims Support Research10.3Test DesignLaboratory Testing 11Product Procurement 11.6Experimental Design 11.7Data Collection 11.8Data Analysis 11.9Questionnaire Construction 12Test Facility 1

25、3Statistical Analysis 14Paired-Preference Studies 14.1Superiority Claims 14.2Parity Claims 14.3Paired Comparison/Difference Studies 14.4Analysis of Data from Scales 14.5Keywords 15Commonly Asked Questions About ASTM and ClaimSubstantiationAppendix X11.2 This international standard was developed in a

26、ccor-dance with internationally recognized principles on standard-ization established in the Decision on Principles for theDevelopment of International Standards, Guides and Recom-mendations issued by the World Trade Organization TechnicalBarriers to Trade (TBT) Committee.2. Referenced Documents2.1

27、ASTM Standards:2E253 Terminology Relating to Sensory Evaluation of Mate-rials and ProductsE1885 Test Method for Sensory AnalysisTriangle TestE2164 Test Method for Directional Difference Test2.2 ASTM Publications:3ASTM Manual 13 Descriptive Analysis Testing for SensoryEvaluationASTM Manual 26 Sensory

28、 Testing Methods: Second EditionSTP 913 Physical Requirement Guidelines for SensoryEvaluation Laboratories3. Terminology3.1 DefinitionsTerms used in this guide are in accordancewith Terminology E253. Additional terms are as follows:3.1.1 attribute difference rating testthis test also deter-mines if

29、one or more specific attributes differ between twosamples. The intensities of the attributes are measured onrating scales showing several degrees of intensity. One or morespecific attributes of the product that relate to the claim arerated. Samples are presented, and the panelists task is toevaluate

30、 and assign each test sample an intensity to reflect theamount of the designated attribute(s).3.1.2 attribute difference testsin these test methods, theattribute of interest is defined prior to testing, and the panelistsare trained to be able to identify the attribute in question andselect or rate t

31、he relative intensity of that attribute. It is notnecessary to evaluate every occurring attribute, only theattributes being addressed in the claim.3.1.3 ceiling effectsthis typically occurs when the majorityof the scores occur toward the top of a rating scale. When theproducts are well-liked, there

32、is not a sufficient amount of scaleavailable to the respondents to differentiate the products.Variation in rating scores is compressed, making mean-based1This guide is under the jurisdiction of ASTM Committee E18 on SensoryEvaluation and is the direct responsibility of Subcommittee E18.05 on Sensory

33、Applications-General.Current edition approved June 1, 2018. Published July 2018. Originally approvedin 1998. Last previous edition approved in 2016 as E1958 16a. DOI: 10.1520/E1958-18.2For referenced ASTM standards, visit the ASTM website, www.astm.org, orcontact ASTM Customer Service at serviceastm

34、.org. For Annual Book of ASTMStandards volume information, refer to the standards Document Summary page onthe ASTM website.3Available from ASTM International Headquarters, 100 Barr Harbor Drive, POBox C700, West Conshohocken, PA 19428-2959.E1958 182statistical tests misleading. Therefore, analysis s

35、hould be per-formed using a more robust statistical model that does not havedistributional requirements and is less prone to outlier influ-ence such as multinomial logistic regression.3.1.4 central location testing (CLT)method of testing thatprovides maximum control over product preparation and us-a

36、ge. Central location testing assures that the participant actu-ally evaluated the product in question and provides his or herown opinion immediately following evaluation, rather thanrelying on past usage or recollection of a CLT.3.1.5 comparative claimsdesigned to compare similaritiesand differences

37、 between two or more products. The basis forcomparison can be within the same brand, between two brands,or between a brand and other products in the category.3.1.6 context/contrast effectflavor/texture of one samplecan have an influence on the perceived flavor/texture of eachsubsequent sample.3.1.7

38、directional difference testthis test method is usedwhen determining whether one sample has more of a particularsensory characteristic than another. Two samples are presented,either simultaneously or sequentially, and the respondentchooses one of the samples as having a higher level of thespecified c

39、haracteristics.3.1.8 equality claimsin equality claims, two products areclaimed to be equal in one or more particular feature.3.1.9 experimental errorvariability between the panelist.This error can be accounted for by using more than one panelistto test each sample.3.1.10 home use testing (HUT)refer

40、s to tests that allowrespondents to use the products in a more natural environment,rather than the controlled environment.3.1.11 measurement errorrepeatability within the indi-vidual panelist. This error can be accounted for by having eachpanelist test a particular sample more than once.3.1.12 monad

41、ic or single product testsproduct tests whereonly one product is experienced and rated.3.1.13 parity claimsparity claims are claims that rankequivalent levels of performance or liking when comparing aparticular product to another product. In general, parity claimsare made relative to a market/catego

42、ry leader. Within parityclaims, two additional classes exist: equality claims andunsurpassed claims.3.1.14 pattern effectany pattern in order will be detectedquickly.3.1.15 positional biasrespondents may be more sensitiveto differences in specific samples in a series, such as the first orlast sample

43、.3.1.16 product variabilitybatch-to-batch variation. Thiserror can be accounted for by testing multiple and representa-tive batches of a product.3.1.17 self-administered questionnairequestionnaires in-dependently completed by the respondent are referred to asself-administered.3.1.18 superiority clai

44、msa superiority claim is supportedif a statistically significant proportion of the respondents preferthe advertisers product.3.1.19 superiority claimssuperiority claims assert a higherlevel of performance or liking relative to another brand.Superiority claims can be opposed to competitive brands (fo

45、rexample, “cleans better than brand Z”) or opposed to an earlierformula of the brand (for example, “now more cleaning powerthan before”).3.1.20 unsurpassed claimsin unsurpassed claims, theclaim stated indicates that the product(s) selected for compari-son is not better/higher (or greater than) in so

46、me way to thetarget product(s) for which the analysis is executed.4. Basis of Claim Classification4.1 Afundamental step in advertising claim substantiation iscreating an explicit statement of the claim prior to actualtesting. The statement is then forwarded to all parties con-cerned in the substanti

47、ation process. Concerned parties couldinclude marketing, marketing research, legal, consumer testing,sensory evaluation, research suppliers, etc. The statement isessential as it can encourage collaboration in terms of corporateresources, confirms the selection of appropriate test methods,and has the

48、 potential to maximize the chance of makingreliable business decisions about the proposed claim, pendingthe results of substantiation research. Collaboration among allinvolved parties prior to executing substantiation research iscritical in achieving the best results.All involved parties shouldmeet

49、and agree (perhaps several times) prior to implementingthe substantiation research.4.2 Familiarity with the general classification of advertisingclaims is important in developing clear statements of claims atan early stage and for developing a rational plan for testing.This familiarity also facilitates the process of selecting appro-priate testing methods, among the many types of methodsavailable to the consumer/sensory science professional. Eachmethod answers specific questions and may support one type ofclaim but not another. Therefore, the consu