Reversed item bias

An integrative model

Bert Weijters, Johann Baumgartner, Niels Schillewaert

Research output: Contribution to journalArticle

75 Citations (Scopus)

Abstract

In the recent methodological literature, various models have been proposed to account for the phenomenon that reversed items (defined as items for which respondents' scores have to be recoded in order to make the direction of keying consistent across all items) tend to lead to problematic responses. In this article we propose an integrative conceptualization of three important sources of reversed item method bias (acquiescence, careless responding, and confirmation bias) and specify a multisample confirmatory factor analysis model with 2 method factors to empirically test the hypothesized mechanisms, using explicit measures of acquiescence and carelessness and experimentally manipulated versions of a questionnaire that varies 3 item arrangements and the keying direction of the first item measuring the focal construct. We explain the mechanisms, review prior attempts to model reversed item bias, present our new model, and apply it to responses to a 4-item self-esteem scale (N 306) and the 6-item Revised Life Orientation Test (N 595). Based on the literature review and the empirical results, we formulate recommendations on how to use reversed items in questionnaires.

Original languageEnglish (US)
Pages (from-to)320-334
Number of pages15
JournalPsychological Methods
Volume18
Issue number3
DOIs
StatePublished - Sep 1 2013

Fingerprint

Self Concept
Statistical Factor Analysis
Surveys and Questionnaires
Direction compound

All Science Journal Classification (ASJC) codes

  • Psychology (miscellaneous)

Cite this

Weijters, Bert ; Baumgartner, Johann ; Schillewaert, Niels. / Reversed item bias : An integrative model. In: Psychological Methods. 2013 ; Vol. 18, No. 3. pp. 320-334.
@article{060d59ff2d284836a3171a3501146309,
title = "Reversed item bias: An integrative model",
abstract = "In the recent methodological literature, various models have been proposed to account for the phenomenon that reversed items (defined as items for which respondents' scores have to be recoded in order to make the direction of keying consistent across all items) tend to lead to problematic responses. In this article we propose an integrative conceptualization of three important sources of reversed item method bias (acquiescence, careless responding, and confirmation bias) and specify a multisample confirmatory factor analysis model with 2 method factors to empirically test the hypothesized mechanisms, using explicit measures of acquiescence and carelessness and experimentally manipulated versions of a questionnaire that varies 3 item arrangements and the keying direction of the first item measuring the focal construct. We explain the mechanisms, review prior attempts to model reversed item bias, present our new model, and apply it to responses to a 4-item self-esteem scale (N 306) and the 6-item Revised Life Orientation Test (N 595). Based on the literature review and the empirical results, we formulate recommendations on how to use reversed items in questionnaires.",
author = "Bert Weijters and Johann Baumgartner and Niels Schillewaert",
year = "2013",
month = "9",
day = "1",
doi = "10.1037/a0032121",
language = "English (US)",
volume = "18",
pages = "320--334",
journal = "Psychological Methods",
issn = "1082-989X",
publisher = "American Psychological Association Inc.",
number = "3",

}

Reversed item bias : An integrative model. / Weijters, Bert; Baumgartner, Johann; Schillewaert, Niels.

In: Psychological Methods, Vol. 18, No. 3, 01.09.2013, p. 320-334.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Reversed item bias

T2 - An integrative model

AU - Weijters, Bert

AU - Baumgartner, Johann

AU - Schillewaert, Niels

PY - 2013/9/1

Y1 - 2013/9/1

N2 - In the recent methodological literature, various models have been proposed to account for the phenomenon that reversed items (defined as items for which respondents' scores have to be recoded in order to make the direction of keying consistent across all items) tend to lead to problematic responses. In this article we propose an integrative conceptualization of three important sources of reversed item method bias (acquiescence, careless responding, and confirmation bias) and specify a multisample confirmatory factor analysis model with 2 method factors to empirically test the hypothesized mechanisms, using explicit measures of acquiescence and carelessness and experimentally manipulated versions of a questionnaire that varies 3 item arrangements and the keying direction of the first item measuring the focal construct. We explain the mechanisms, review prior attempts to model reversed item bias, present our new model, and apply it to responses to a 4-item self-esteem scale (N 306) and the 6-item Revised Life Orientation Test (N 595). Based on the literature review and the empirical results, we formulate recommendations on how to use reversed items in questionnaires.

AB - In the recent methodological literature, various models have been proposed to account for the phenomenon that reversed items (defined as items for which respondents' scores have to be recoded in order to make the direction of keying consistent across all items) tend to lead to problematic responses. In this article we propose an integrative conceptualization of three important sources of reversed item method bias (acquiescence, careless responding, and confirmation bias) and specify a multisample confirmatory factor analysis model with 2 method factors to empirically test the hypothesized mechanisms, using explicit measures of acquiescence and carelessness and experimentally manipulated versions of a questionnaire that varies 3 item arrangements and the keying direction of the first item measuring the focal construct. We explain the mechanisms, review prior attempts to model reversed item bias, present our new model, and apply it to responses to a 4-item self-esteem scale (N 306) and the 6-item Revised Life Orientation Test (N 595). Based on the literature review and the empirical results, we formulate recommendations on how to use reversed items in questionnaires.

UR - http://www.scopus.com/inward/record.url?scp=84881128790&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84881128790&partnerID=8YFLogxK

U2 - 10.1037/a0032121

DO - 10.1037/a0032121

M3 - Article

VL - 18

SP - 320

EP - 334

JO - Psychological Methods

JF - Psychological Methods

SN - 1082-989X

IS - 3

ER -