148576 - Scale norming undermines.pdf (1.62 MB)
Scale norming undermines the use of life satisfaction scale data for welfare analysis
journal contribution
posted on 2023-05-21, 05:20 authored by Mark FabianScale norming is where respondents use qualitatively different scales to answer the same question across survey waves. It makes responses challenging to compare intertemporally or interpersonally. This paper develops a formal model of the cognitive process that could give rise to scale norming in year on year responses to life satisfaction scale questions. It then uses this model to conceptually differentiate scale norming from adaptation and changes in reference points. Scale norming could make life satisfaction responses misleading with regards to the changing welfare of individuals. In particular, individuals who would say that their life is "improving" or "going well" might nonetheless give the same scale response year after year. This has negative implications for the use of scales in cost–benefit analysis and other welfarist applications. While there is already substantial empirical evidence for the existence of scale norming, its implications for welfare analysis are sometimes understated on the grounds that this evidence might simply be the product of errors of memory. The paper presents new empirical evidence for scale norming from two surveys (N1 = 278; N2 = 1050) designed such that errors of memory are an unconvincing explanation for the results.
History
Publication title
Journal of Happiness StudiesVolume
23Issue
4Pagination
1509-1541ISSN
1389-4978Publisher
Springer NetherlandsPlace of publication
NetherlandsRights statement
© The Author(s) 2021. This article is licensed under a Creative Commons Attribution 4.0 International (CC BY 4.0) License, (https://creativecommons.org/licenses/by/4.0/) which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.Repository Status
- Open