Precision of Curriculum-Based Measurement Reading Data: Considerations for Multiple-Baseline Designs

David A. Klingbeil, Ethan R. Van Norman, Peter Marlow Nelson

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Single-case designs provide an established technology for evaluating the effects of academic interventions. Researchers interested in studying the long-term effects of reading interventions often use curriculum-based measures of reading (CBM-R) as they possess many of the desirable characteristics for use in a time-series design. The reliability of CBM-R scores is often supported by research from group designs, but making idiographic interpretations regarding the change in a student’s oral reading rate requires attention to the precision of static scores and growth estimates. The purpose of this paper is twofold. First, we discuss how recent empirical work on the technical adequacy of CBM-R scores has revealed multiple threats to the data-evaluation validity when CBM-R passages are used to measure oral reading rate. Second, we identify pertinent considerations for conducting a visual analysis of intervention effects based on CBM-R data. We conclude with a brief discussion of implications for researchers considering the use of CBM-R within multiple-baseline designs.

Original languageEnglish (US)
Pages (from-to)433-451
Number of pages19
JournalJournal of Behavioral Education
Volume26
Issue number4
DOIs
StatePublished - Dec 1 2017

Fingerprint

Curriculum
Reading
curriculum
Research Personnel
time series
data analysis
Research Design
threat
Students
Technology
interpretation
Growth

All Science Journal Classification (ASJC) codes

  • Education
  • Developmental and Educational Psychology

Cite this

@article{32d5668753434a1bbb499298d39de757,
title = "Precision of Curriculum-Based Measurement Reading Data: Considerations for Multiple-Baseline Designs",
abstract = "Single-case designs provide an established technology for evaluating the effects of academic interventions. Researchers interested in studying the long-term effects of reading interventions often use curriculum-based measures of reading (CBM-R) as they possess many of the desirable characteristics for use in a time-series design. The reliability of CBM-R scores is often supported by research from group designs, but making idiographic interpretations regarding the change in a student’s oral reading rate requires attention to the precision of static scores and growth estimates. The purpose of this paper is twofold. First, we discuss how recent empirical work on the technical adequacy of CBM-R scores has revealed multiple threats to the data-evaluation validity when CBM-R passages are used to measure oral reading rate. Second, we identify pertinent considerations for conducting a visual analysis of intervention effects based on CBM-R data. We conclude with a brief discussion of implications for researchers considering the use of CBM-R within multiple-baseline designs.",
author = "Klingbeil, {David A.} and {Van Norman}, {Ethan R.} and Nelson, {Peter Marlow}",
year = "2017",
month = "12",
day = "1",
doi = "10.1007/s10864-017-9282-7",
language = "English (US)",
volume = "26",
pages = "433--451",
journal = "Journal of Behavioral Education",
issn = "1053-0819",
publisher = "Springer New York",
number = "4",

}

Precision of Curriculum-Based Measurement Reading Data : Considerations for Multiple-Baseline Designs. / Klingbeil, David A.; Van Norman, Ethan R.; Nelson, Peter Marlow.

In: Journal of Behavioral Education, Vol. 26, No. 4, 01.12.2017, p. 433-451.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Precision of Curriculum-Based Measurement Reading Data

T2 - Considerations for Multiple-Baseline Designs

AU - Klingbeil, David A.

AU - Van Norman, Ethan R.

AU - Nelson, Peter Marlow

PY - 2017/12/1

Y1 - 2017/12/1

N2 - Single-case designs provide an established technology for evaluating the effects of academic interventions. Researchers interested in studying the long-term effects of reading interventions often use curriculum-based measures of reading (CBM-R) as they possess many of the desirable characteristics for use in a time-series design. The reliability of CBM-R scores is often supported by research from group designs, but making idiographic interpretations regarding the change in a student’s oral reading rate requires attention to the precision of static scores and growth estimates. The purpose of this paper is twofold. First, we discuss how recent empirical work on the technical adequacy of CBM-R scores has revealed multiple threats to the data-evaluation validity when CBM-R passages are used to measure oral reading rate. Second, we identify pertinent considerations for conducting a visual analysis of intervention effects based on CBM-R data. We conclude with a brief discussion of implications for researchers considering the use of CBM-R within multiple-baseline designs.

AB - Single-case designs provide an established technology for evaluating the effects of academic interventions. Researchers interested in studying the long-term effects of reading interventions often use curriculum-based measures of reading (CBM-R) as they possess many of the desirable characteristics for use in a time-series design. The reliability of CBM-R scores is often supported by research from group designs, but making idiographic interpretations regarding the change in a student’s oral reading rate requires attention to the precision of static scores and growth estimates. The purpose of this paper is twofold. First, we discuss how recent empirical work on the technical adequacy of CBM-R scores has revealed multiple threats to the data-evaluation validity when CBM-R passages are used to measure oral reading rate. Second, we identify pertinent considerations for conducting a visual analysis of intervention effects based on CBM-R data. We conclude with a brief discussion of implications for researchers considering the use of CBM-R within multiple-baseline designs.

UR - http://www.scopus.com/inward/record.url?scp=85030707083&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85030707083&partnerID=8YFLogxK

U2 - 10.1007/s10864-017-9282-7

DO - 10.1007/s10864-017-9282-7

M3 - Article

AN - SCOPUS:85030707083

VL - 26

SP - 433

EP - 451

JO - Journal of Behavioral Education

JF - Journal of Behavioral Education

SN - 1053-0819

IS - 4

ER -