Abstract
Using a self-administered questionnaire, 149 respondents rated service elements associated with a recently visited store or restaurant on scales that differed only in the number of response categories (ranging from 2 to 11) and on a 101-point scale presented in a different format. On several indices of reliability, validity, and discriminating power, the two-point, three-point, and four-point scales performed relatively poorly, and indices were significantly higher for scales with more response categories, up to about 7. Internal consistency did not differ significantly between scales, but test-retest reliability tended to decrease for scales with more than 10 response categories. Respondent preferences were highest for the 10-point scale, closely followed by the seven-point and nine-point scales. Implications for research and practice are discussed.
Keywords
RespondentReliability (semiconductor)PsychologyRating scaleScale (ratio)Consistency (knowledge bases)StatisticsPoint (geometry)Internal consistencySocial psychologyPsychometricsMathematicsEconometricsPower (physics)Clinical psychologyGeography
MeSH Terms
AdolescentAdultFemaleHumansMaleObserver VariationPsychological TestsPsychometricsReproducibility of ResultsSurveys and Questionnaires
Affiliated Institutions
Related Publications
Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer
Scale development and validation are critical to much of the work in the health, social, and behavioral sciences. However, the constellation of techniques required for scale dev...
Toward Understanding and Measuring Conditions of Trust: Evolution of a Conditions of Trust Inventory
Ten conditions of trust were suggested by 84 interviews of managers, and two previous studies of managerial trust. Statements made in the interviews and the studies were used to...
Health Measurement Scales: A Practical Guide to Their Development and Use
1. Introduction 2. Basic concepts 3. Devising the items 4. Scaling responses 5. Selecting the items 6. Biases in responding 7. From items to scales 8. Reliability 9. Generalizab...
Publication Info
- Year
- 2000
- Type
- article
- Volume
- 104
- Issue
- 1
- Pages
- 1-15
- Citations
- 1848
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
1848
OpenAlex
63
Influential
1295
CrossRef
Cite This
Carolyn C. Preston,
Andrew M. Colman
(2000).
Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences.
Acta Psychologica
, 104
(1)
, 1-15.
https://doi.org/10.1016/s0001-6918(99)00050-5
Identifiers
- DOI
- 10.1016/s0001-6918(99)00050-5
- PMID
- 10769936