Conditional Reasoning: An Integrated Approach to Item Analysis

Daniel R. Smith, Michael E. Hoffman, James M. LeBreton

Research output: Contribution to journalReview article

Abstract

This article provides a review of the approach that James used when conducting item analyses on his conditional reasoning test items. That approach was anchored in classical test theory. Our article extends this work in two important ways. First, we offer a set of test development protocols that are tailored to the unique nature of conditional reasoning tests. Second, we further extend James’s approach by integrating his early test validation protocols (based on classical test theory) with more recent protocols (based on item response theory). We then apply our integrated item analytic framework to data collected on James’s first test, the conditional reasoning test for relative motive strength. We illustrate how this integrated approach furnishes additional diagnostic information that may allow researchers to make more informed and targeted revisions to an initial set of items.

Original languageEnglish (US)
Pages (from-to)124-153
Number of pages30
JournalOrganizational Research Methods
Volume23
Issue number1
DOIs
StatePublished - Jan 1 2020

Fingerprint

Integrated approach
Integrated
Diagnostics
Item response theory

All Science Journal Classification (ASJC) codes

  • Decision Sciences(all)
  • Strategy and Management
  • Management of Technology and Innovation

Cite this

Smith, Daniel R. ; Hoffman, Michael E. ; LeBreton, James M. / Conditional Reasoning : An Integrated Approach to Item Analysis. In: Organizational Research Methods. 2020 ; Vol. 23, No. 1. pp. 124-153.
@article{eca5076b21dc4fa291f79b0fa57e57bc,
title = "Conditional Reasoning: An Integrated Approach to Item Analysis",
abstract = "This article provides a review of the approach that James used when conducting item analyses on his conditional reasoning test items. That approach was anchored in classical test theory. Our article extends this work in two important ways. First, we offer a set of test development protocols that are tailored to the unique nature of conditional reasoning tests. Second, we further extend James’s approach by integrating his early test validation protocols (based on classical test theory) with more recent protocols (based on item response theory). We then apply our integrated item analytic framework to data collected on James’s first test, the conditional reasoning test for relative motive strength. We illustrate how this integrated approach furnishes additional diagnostic information that may allow researchers to make more informed and targeted revisions to an initial set of items.",
author = "Smith, {Daniel R.} and Hoffman, {Michael E.} and LeBreton, {James M.}",
year = "2020",
month = "1",
day = "1",
doi = "10.1177/1094428119879756",
language = "English (US)",
volume = "23",
pages = "124--153",
journal = "Organizational Research Methods",
issn = "1094-4281",
publisher = "SAGE Publications Inc.",
number = "1",

}

Conditional Reasoning : An Integrated Approach to Item Analysis. / Smith, Daniel R.; Hoffman, Michael E.; LeBreton, James M.

In: Organizational Research Methods, Vol. 23, No. 1, 01.01.2020, p. 124-153.

Research output: Contribution to journalReview article

TY - JOUR

T1 - Conditional Reasoning

T2 - An Integrated Approach to Item Analysis

AU - Smith, Daniel R.

AU - Hoffman, Michael E.

AU - LeBreton, James M.

PY - 2020/1/1

Y1 - 2020/1/1

N2 - This article provides a review of the approach that James used when conducting item analyses on his conditional reasoning test items. That approach was anchored in classical test theory. Our article extends this work in two important ways. First, we offer a set of test development protocols that are tailored to the unique nature of conditional reasoning tests. Second, we further extend James’s approach by integrating his early test validation protocols (based on classical test theory) with more recent protocols (based on item response theory). We then apply our integrated item analytic framework to data collected on James’s first test, the conditional reasoning test for relative motive strength. We illustrate how this integrated approach furnishes additional diagnostic information that may allow researchers to make more informed and targeted revisions to an initial set of items.

AB - This article provides a review of the approach that James used when conducting item analyses on his conditional reasoning test items. That approach was anchored in classical test theory. Our article extends this work in two important ways. First, we offer a set of test development protocols that are tailored to the unique nature of conditional reasoning tests. Second, we further extend James’s approach by integrating his early test validation protocols (based on classical test theory) with more recent protocols (based on item response theory). We then apply our integrated item analytic framework to data collected on James’s first test, the conditional reasoning test for relative motive strength. We illustrate how this integrated approach furnishes additional diagnostic information that may allow researchers to make more informed and targeted revisions to an initial set of items.

UR - http://www.scopus.com/inward/record.url?scp=85074399507&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85074399507&partnerID=8YFLogxK

U2 - 10.1177/1094428119879756

DO - 10.1177/1094428119879756

M3 - Review article

AN - SCOPUS:85074399507

VL - 23

SP - 124

EP - 153

JO - Organizational Research Methods

JF - Organizational Research Methods

SN - 1094-4281

IS - 1

ER -