An Evaluation of the Use of Seasonal Goal Lines to Improve the Accuracy of Curriculum-Based Measurement of Reading Decision Rule Recommendations

Ethan R. Van Norman, Peter M. Nelson

Research output: Contribution to journalArticle

Abstract

The current study evaluated whether goal-setting practices that account for seasonal developmental patterns of reading growth decreased the number of weeks data needed to be collected in order to yield accurate response to intervention decisions for a sample of 224 third-grade students. The extent to which more complex decision-making practices improve upon the accuracy of current frameworks across periods of 4 to 8 weeks was also explored. Spring proficiency status on a curriculum-based measurement of reading assessment was used as the reference for classification accuracy. Using a goal line based upon fall to winter grade-level benchmarks tended to produce higher levels of accuracy, kappa, and sensitivity than goal lines based upon fall to spring benchmarks. Collectively, the observed results highlight the potential benefit of establishing seasonal goal lines and suggest that relatively simplistic and accessible approaches to decision-making may result in similar decisions when compared with analytically complex approaches.

Original languageEnglish (US)
JournalAssessment for Effective Intervention
DOIs
StateAccepted/In press - Jan 1 2019

Fingerprint

Curriculum
Reading
decision making
Benchmarking
curriculum
evaluation
Decision Making
student
Students
Growth

All Science Journal Classification (ASJC) codes

  • Education
  • Developmental and Educational Psychology
  • Health Professions(all)

Cite this

@article{55bc43bc5b944f9486fb12e0f34c2ca5,
title = "An Evaluation of the Use of Seasonal Goal Lines to Improve the Accuracy of Curriculum-Based Measurement of Reading Decision Rule Recommendations",
abstract = "The current study evaluated whether goal-setting practices that account for seasonal developmental patterns of reading growth decreased the number of weeks data needed to be collected in order to yield accurate response to intervention decisions for a sample of 224 third-grade students. The extent to which more complex decision-making practices improve upon the accuracy of current frameworks across periods of 4 to 8 weeks was also explored. Spring proficiency status on a curriculum-based measurement of reading assessment was used as the reference for classification accuracy. Using a goal line based upon fall to winter grade-level benchmarks tended to produce higher levels of accuracy, kappa, and sensitivity than goal lines based upon fall to spring benchmarks. Collectively, the observed results highlight the potential benefit of establishing seasonal goal lines and suggest that relatively simplistic and accessible approaches to decision-making may result in similar decisions when compared with analytically complex approaches.",
author = "{Van Norman}, {Ethan R.} and Nelson, {Peter M.}",
year = "2019",
month = "1",
day = "1",
doi = "10.1177/1534508419872249",
language = "English (US)",
journal = "Assessment for Effective Intervention",
issn = "1534-5084",
publisher = "Council for Exceptional Children, Council for Educational Diagnostic Services",

}

TY - JOUR

T1 - An Evaluation of the Use of Seasonal Goal Lines to Improve the Accuracy of Curriculum-Based Measurement of Reading Decision Rule Recommendations

AU - Van Norman, Ethan R.

AU - Nelson, Peter M.

PY - 2019/1/1

Y1 - 2019/1/1

N2 - The current study evaluated whether goal-setting practices that account for seasonal developmental patterns of reading growth decreased the number of weeks data needed to be collected in order to yield accurate response to intervention decisions for a sample of 224 third-grade students. The extent to which more complex decision-making practices improve upon the accuracy of current frameworks across periods of 4 to 8 weeks was also explored. Spring proficiency status on a curriculum-based measurement of reading assessment was used as the reference for classification accuracy. Using a goal line based upon fall to winter grade-level benchmarks tended to produce higher levels of accuracy, kappa, and sensitivity than goal lines based upon fall to spring benchmarks. Collectively, the observed results highlight the potential benefit of establishing seasonal goal lines and suggest that relatively simplistic and accessible approaches to decision-making may result in similar decisions when compared with analytically complex approaches.

AB - The current study evaluated whether goal-setting practices that account for seasonal developmental patterns of reading growth decreased the number of weeks data needed to be collected in order to yield accurate response to intervention decisions for a sample of 224 third-grade students. The extent to which more complex decision-making practices improve upon the accuracy of current frameworks across periods of 4 to 8 weeks was also explored. Spring proficiency status on a curriculum-based measurement of reading assessment was used as the reference for classification accuracy. Using a goal line based upon fall to winter grade-level benchmarks tended to produce higher levels of accuracy, kappa, and sensitivity than goal lines based upon fall to spring benchmarks. Collectively, the observed results highlight the potential benefit of establishing seasonal goal lines and suggest that relatively simplistic and accessible approaches to decision-making may result in similar decisions when compared with analytically complex approaches.

UR - http://www.scopus.com/inward/record.url?scp=85073776353&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073776353&partnerID=8YFLogxK

U2 - 10.1177/1534508419872249

DO - 10.1177/1534508419872249

M3 - Article

AN - SCOPUS:85073776353

JO - Assessment for Effective Intervention

JF - Assessment for Effective Intervention

SN - 1534-5084

ER -