Reduce, Reuse, Recycle

The Longitudinal Value of Local Cut Scores Using State Test Data

Peter Marlow Nelson, Ethan R. Van Norman, Amanda VanDerHeyden

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

We used existing reading (n = 1,498) and math (n = 2,260) data to evaluate state test scores for screening middle school students. In Phase 1, state test data were used to create a research-derived cut score that was optimal for predicting state test performance the following year. In Phase 2, those cut scores were applied with future cohorts. Diagnostic accuracy of the research-derived cut scores was compared with the state’s proficiency benchmark from the previous year. Across grades and content areas, research-derived cut scores yielded higher sensitivity and lower specificity values relative to state-defined cut scores. Marked decreases in sensitivity and specificity were not observed in subsequent years. Results provide evidence for procedures in which previous state test data are repurposed for screening decisions.

Original languageEnglish (US)
Pages (from-to)683-694
Number of pages12
JournalJournal of Psychoeducational Assessment
Volume35
Issue number7
DOIs
StatePublished - Oct 1 2017

Fingerprint

Research
Benchmarking
Sensitivity and Specificity
Reading
Students
diagnostic
performance
evidence
Values
student

All Science Journal Classification (ASJC) codes

  • Education
  • Clinical Psychology
  • Psychology(all)

Cite this

@article{25413736d6da4fd18bb78f62ac55cbf4,
title = "Reduce, Reuse, Recycle: The Longitudinal Value of Local Cut Scores Using State Test Data",
abstract = "We used existing reading (n = 1,498) and math (n = 2,260) data to evaluate state test scores for screening middle school students. In Phase 1, state test data were used to create a research-derived cut score that was optimal for predicting state test performance the following year. In Phase 2, those cut scores were applied with future cohorts. Diagnostic accuracy of the research-derived cut scores was compared with the state’s proficiency benchmark from the previous year. Across grades and content areas, research-derived cut scores yielded higher sensitivity and lower specificity values relative to state-defined cut scores. Marked decreases in sensitivity and specificity were not observed in subsequent years. Results provide evidence for procedures in which previous state test data are repurposed for screening decisions.",
author = "Nelson, {Peter Marlow} and {Van Norman}, {Ethan R.} and Amanda VanDerHeyden",
year = "2017",
month = "10",
day = "1",
doi = "10.1177/0734282916658567",
language = "English (US)",
volume = "35",
pages = "683--694",
journal = "Journal of Psychoeducational Assessment",
issn = "0734-2829",
publisher = "SAGE Publications Inc.",
number = "7",

}

Reduce, Reuse, Recycle : The Longitudinal Value of Local Cut Scores Using State Test Data. / Nelson, Peter Marlow; Van Norman, Ethan R.; VanDerHeyden, Amanda.

In: Journal of Psychoeducational Assessment, Vol. 35, No. 7, 01.10.2017, p. 683-694.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Reduce, Reuse, Recycle

T2 - The Longitudinal Value of Local Cut Scores Using State Test Data

AU - Nelson, Peter Marlow

AU - Van Norman, Ethan R.

AU - VanDerHeyden, Amanda

PY - 2017/10/1

Y1 - 2017/10/1

N2 - We used existing reading (n = 1,498) and math (n = 2,260) data to evaluate state test scores for screening middle school students. In Phase 1, state test data were used to create a research-derived cut score that was optimal for predicting state test performance the following year. In Phase 2, those cut scores were applied with future cohorts. Diagnostic accuracy of the research-derived cut scores was compared with the state’s proficiency benchmark from the previous year. Across grades and content areas, research-derived cut scores yielded higher sensitivity and lower specificity values relative to state-defined cut scores. Marked decreases in sensitivity and specificity were not observed in subsequent years. Results provide evidence for procedures in which previous state test data are repurposed for screening decisions.

AB - We used existing reading (n = 1,498) and math (n = 2,260) data to evaluate state test scores for screening middle school students. In Phase 1, state test data were used to create a research-derived cut score that was optimal for predicting state test performance the following year. In Phase 2, those cut scores were applied with future cohorts. Diagnostic accuracy of the research-derived cut scores was compared with the state’s proficiency benchmark from the previous year. Across grades and content areas, research-derived cut scores yielded higher sensitivity and lower specificity values relative to state-defined cut scores. Marked decreases in sensitivity and specificity were not observed in subsequent years. Results provide evidence for procedures in which previous state test data are repurposed for screening decisions.

UR - http://www.scopus.com/inward/record.url?scp=85028746891&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85028746891&partnerID=8YFLogxK

U2 - 10.1177/0734282916658567

DO - 10.1177/0734282916658567

M3 - Article

VL - 35

SP - 683

EP - 694

JO - Journal of Psychoeducational Assessment

JF - Journal of Psychoeducational Assessment

SN - 0734-2829

IS - 7

ER -