The Reliability of Survey Attitude Measurement: The Influence of Question and Respondent Attributes

Duane F. Alwin, Jon A. Krosnick

Research output: Contribution to journalArticle

183 Citations (Scopus)

Abstract

Several theoretical hypotheses are developed concerning the relation of question and respondent characteristics to the reliability of survey attitude measurement. To test these hypotheses, reliability is estimated for 96 survey attitude measures using data from five, 3-wave national reinterview surveys-three Michigan Election Panel Surveys and two reinterview studies conducted by the General Social Survey. As hypothesized, a number of attributes of questions are linked to estimated reliability. Attitude questions with more response options tended to have higher reliabilities, although there are some important exceptions. More extensive verbal labeling of numbered response options was found to be associated with higher reliability, but questions explicitly offering a “don't know” alternative were not found to be more reliable. Question characteristics were confounded to an unknown degree with topic differences of questions, which were significantly linked to reliability, leaving the influence of question characteristics on reliability somewhat ambiguous. Characteristics of respondents were also found to be related to levels of reliability. Older respondents and those with less schooling provided the least reliable attitude reports. These results are discussed within a general framework for the consideration of survey errors and their sources.

Original languageEnglish (US)
Pages (from-to)139-181
Number of pages43
JournalSociological Methods & Research
Volume20
Issue number1
DOIs
StatePublished - Aug 1991

Fingerprint

attitude measurement
election

All Science Journal Classification (ASJC) codes

  • Social Sciences (miscellaneous)
  • Sociology and Political Science

Cite this

@article{0707dbb247464205a75d3c31f10b659c,
title = "The Reliability of Survey Attitude Measurement: The Influence of Question and Respondent Attributes",
abstract = "Several theoretical hypotheses are developed concerning the relation of question and respondent characteristics to the reliability of survey attitude measurement. To test these hypotheses, reliability is estimated for 96 survey attitude measures using data from five, 3-wave national reinterview surveys-three Michigan Election Panel Surveys and two reinterview studies conducted by the General Social Survey. As hypothesized, a number of attributes of questions are linked to estimated reliability. Attitude questions with more response options tended to have higher reliabilities, although there are some important exceptions. More extensive verbal labeling of numbered response options was found to be associated with higher reliability, but questions explicitly offering a “don't know” alternative were not found to be more reliable. Question characteristics were confounded to an unknown degree with topic differences of questions, which were significantly linked to reliability, leaving the influence of question characteristics on reliability somewhat ambiguous. Characteristics of respondents were also found to be related to levels of reliability. Older respondents and those with less schooling provided the least reliable attitude reports. These results are discussed within a general framework for the consideration of survey errors and their sources.",
author = "Alwin, {Duane F.} and Krosnick, {Jon A.}",
year = "1991",
month = "8",
doi = "10.1177/0049124191020001005",
language = "English (US)",
volume = "20",
pages = "139--181",
journal = "Sociological Methods and Research",
issn = "0049-1241",
publisher = "SAGE Publications Inc.",
number = "1",

}

The Reliability of Survey Attitude Measurement : The Influence of Question and Respondent Attributes. / Alwin, Duane F.; Krosnick, Jon A.

In: Sociological Methods & Research, Vol. 20, No. 1, 08.1991, p. 139-181.

Research output: Contribution to journalArticle

TY - JOUR

T1 - The Reliability of Survey Attitude Measurement

T2 - The Influence of Question and Respondent Attributes

AU - Alwin, Duane F.

AU - Krosnick, Jon A.

PY - 1991/8

Y1 - 1991/8

N2 - Several theoretical hypotheses are developed concerning the relation of question and respondent characteristics to the reliability of survey attitude measurement. To test these hypotheses, reliability is estimated for 96 survey attitude measures using data from five, 3-wave national reinterview surveys-three Michigan Election Panel Surveys and two reinterview studies conducted by the General Social Survey. As hypothesized, a number of attributes of questions are linked to estimated reliability. Attitude questions with more response options tended to have higher reliabilities, although there are some important exceptions. More extensive verbal labeling of numbered response options was found to be associated with higher reliability, but questions explicitly offering a “don't know” alternative were not found to be more reliable. Question characteristics were confounded to an unknown degree with topic differences of questions, which were significantly linked to reliability, leaving the influence of question characteristics on reliability somewhat ambiguous. Characteristics of respondents were also found to be related to levels of reliability. Older respondents and those with less schooling provided the least reliable attitude reports. These results are discussed within a general framework for the consideration of survey errors and their sources.

AB - Several theoretical hypotheses are developed concerning the relation of question and respondent characteristics to the reliability of survey attitude measurement. To test these hypotheses, reliability is estimated for 96 survey attitude measures using data from five, 3-wave national reinterview surveys-three Michigan Election Panel Surveys and two reinterview studies conducted by the General Social Survey. As hypothesized, a number of attributes of questions are linked to estimated reliability. Attitude questions with more response options tended to have higher reliabilities, although there are some important exceptions. More extensive verbal labeling of numbered response options was found to be associated with higher reliability, but questions explicitly offering a “don't know” alternative were not found to be more reliable. Question characteristics were confounded to an unknown degree with topic differences of questions, which were significantly linked to reliability, leaving the influence of question characteristics on reliability somewhat ambiguous. Characteristics of respondents were also found to be related to levels of reliability. Older respondents and those with less schooling provided the least reliable attitude reports. These results are discussed within a general framework for the consideration of survey errors and their sources.

UR - http://www.scopus.com/inward/record.url?scp=84970103689&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84970103689&partnerID=8YFLogxK

U2 - 10.1177/0049124191020001005

DO - 10.1177/0049124191020001005

M3 - Article

AN - SCOPUS:84970103689

VL - 20

SP - 139

EP - 181

JO - Sociological Methods and Research

JF - Sociological Methods and Research

SN - 0049-1241

IS - 1

ER -