A test of the form-resistant correlation hypothesis: Ratings, rankings, and the measurement of values

Jon A. Krosnick, Duane F. Alwin

Research output: Contribution to journalArticle

113 Citations (Scopus)

Abstract

A number of researchers have argued that ranking techniques are more appropriate than rating methods for the measurement of values in surveys. The form-resistant correlation hypothesis proposes that observed associations among values and between values and other variables should remain invariant across measurement methods. However, some recent research on parental values for child qualities suggests that ratings and rankings produce different correlational results. The present study tests the hypothesis that discrepancies between rating and ranking results are due to the fact that, when responding to rating questions, some respondents avoid making difficult choices between valued qualities by rating all the qualities as highly and equally desirable. Consistent with this hypothesis, when nondifferentiating respondents are removed from the analyzed sample, the substantive results of analyses of rating data resemble the results typically obtained using ranking data. This suggests that ranking may be the superior method for measuring values.

Original languageEnglish (US)
Pages (from-to)526-538
Number of pages13
JournalPublic Opinion Quarterly
Volume52
Issue number4
DOIs
StatePublished - Dec 1 1988

Fingerprint

ranking
rating
Values
measurement method
Ranking
Rating

All Science Journal Classification (ASJC) codes

  • Communication
  • History
  • Sociology and Political Science
  • Social Sciences(all)
  • History and Philosophy of Science

Cite this

@article{8abd71f0be8545fcae058d2959368f66,
title = "A test of the form-resistant correlation hypothesis: Ratings, rankings, and the measurement of values",
abstract = "A number of researchers have argued that ranking techniques are more appropriate than rating methods for the measurement of values in surveys. The form-resistant correlation hypothesis proposes that observed associations among values and between values and other variables should remain invariant across measurement methods. However, some recent research on parental values for child qualities suggests that ratings and rankings produce different correlational results. The present study tests the hypothesis that discrepancies between rating and ranking results are due to the fact that, when responding to rating questions, some respondents avoid making difficult choices between valued qualities by rating all the qualities as highly and equally desirable. Consistent with this hypothesis, when nondifferentiating respondents are removed from the analyzed sample, the substantive results of analyses of rating data resemble the results typically obtained using ranking data. This suggests that ranking may be the superior method for measuring values.",
author = "Krosnick, {Jon A.} and Alwin, {Duane F.}",
year = "1988",
month = "12",
day = "1",
doi = "10.1086/269128",
language = "English (US)",
volume = "52",
pages = "526--538",
journal = "Public Opinion Quarterly",
issn = "0033-362X",
publisher = "Oxford University Press",
number = "4",

}

A test of the form-resistant correlation hypothesis : Ratings, rankings, and the measurement of values. / Krosnick, Jon A.; Alwin, Duane F.

In: Public Opinion Quarterly, Vol. 52, No. 4, 01.12.1988, p. 526-538.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A test of the form-resistant correlation hypothesis

T2 - Ratings, rankings, and the measurement of values

AU - Krosnick, Jon A.

AU - Alwin, Duane F.

PY - 1988/12/1

Y1 - 1988/12/1

N2 - A number of researchers have argued that ranking techniques are more appropriate than rating methods for the measurement of values in surveys. The form-resistant correlation hypothesis proposes that observed associations among values and between values and other variables should remain invariant across measurement methods. However, some recent research on parental values for child qualities suggests that ratings and rankings produce different correlational results. The present study tests the hypothesis that discrepancies between rating and ranking results are due to the fact that, when responding to rating questions, some respondents avoid making difficult choices between valued qualities by rating all the qualities as highly and equally desirable. Consistent with this hypothesis, when nondifferentiating respondents are removed from the analyzed sample, the substantive results of analyses of rating data resemble the results typically obtained using ranking data. This suggests that ranking may be the superior method for measuring values.

AB - A number of researchers have argued that ranking techniques are more appropriate than rating methods for the measurement of values in surveys. The form-resistant correlation hypothesis proposes that observed associations among values and between values and other variables should remain invariant across measurement methods. However, some recent research on parental values for child qualities suggests that ratings and rankings produce different correlational results. The present study tests the hypothesis that discrepancies between rating and ranking results are due to the fact that, when responding to rating questions, some respondents avoid making difficult choices between valued qualities by rating all the qualities as highly and equally desirable. Consistent with this hypothesis, when nondifferentiating respondents are removed from the analyzed sample, the substantive results of analyses of rating data resemble the results typically obtained using ranking data. This suggests that ranking may be the superior method for measuring values.

UR - http://www.scopus.com/inward/record.url?scp=0001238587&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0001238587&partnerID=8YFLogxK

U2 - 10.1086/269128

DO - 10.1086/269128

M3 - Article

AN - SCOPUS:0001238587

VL - 52

SP - 526

EP - 538

JO - Public Opinion Quarterly

JF - Public Opinion Quarterly

SN - 0033-362X

IS - 4

ER -