An Examination of Interventionist Implementation Fidelity and Content Knowledge as Predictors of Math Intervention Effectiveness

Peter Marlow Nelson, Ethan R. Van Norman, David C. Parker, Damien C. Cormier

Research output: Contribution to journalArticle

Abstract

Data from a large-scale math intervention program were used to evaluate the degree to which implementation fidelity (IF) and interventionist content knowledge were associated with student outcomes. Data were available for 33 interventionists serving 658 students in Grades 4–6 across one school year. A series of multilevel models were fit to the data to evaluate the impact of procedural IF and interventionists’ math content knowledge on students’ postintervention achievement, controlling for preintervention achievement and intervention dosage. Higher student posttest scores were observed for interventionists with an average fidelity rating of 95% or greater (β =.15); however, no effects on students’ math achievement scores were observed for interventionist content knowledge. Adding IF and a measure of interventionist content knowledge to the model explained a statistically significant amount of variance in growth estimates attributable to interventionists (15%). Results highlight the potential importance of ongoing evaluation and remediation of IF in the context of standardized supplemental intervention in math, while also providing some evidence that higher levels of content knowledge may not translate into greater impact in a standard-protocol intervention setting. Results suggest a need for more research examining characteristics of interventionists and aspects of implementation that may account for variance in student outcomes.

Original languageEnglish (US)
JournalJournal of Applied School Psychology
DOIs
StatePublished - Jan 1 2019

Fingerprint

Students
examination
student
school grade
rating
Growth
evaluation
Research
school
evidence

All Science Journal Classification (ASJC) codes

  • Education
  • Developmental and Educational Psychology
  • Applied Psychology
  • Psychiatry and Mental health

Cite this

@article{62e5540939104bff9a0cf44fecb2c29e,
title = "An Examination of Interventionist Implementation Fidelity and Content Knowledge as Predictors of Math Intervention Effectiveness",
abstract = "Data from a large-scale math intervention program were used to evaluate the degree to which implementation fidelity (IF) and interventionist content knowledge were associated with student outcomes. Data were available for 33 interventionists serving 658 students in Grades 4–6 across one school year. A series of multilevel models were fit to the data to evaluate the impact of procedural IF and interventionists’ math content knowledge on students’ postintervention achievement, controlling for preintervention achievement and intervention dosage. Higher student posttest scores were observed for interventionists with an average fidelity rating of 95{\%} or greater (β =.15); however, no effects on students’ math achievement scores were observed for interventionist content knowledge. Adding IF and a measure of interventionist content knowledge to the model explained a statistically significant amount of variance in growth estimates attributable to interventionists (15{\%}). Results highlight the potential importance of ongoing evaluation and remediation of IF in the context of standardized supplemental intervention in math, while also providing some evidence that higher levels of content knowledge may not translate into greater impact in a standard-protocol intervention setting. Results suggest a need for more research examining characteristics of interventionists and aspects of implementation that may account for variance in student outcomes.",
author = "Nelson, {Peter Marlow} and {Van Norman}, {Ethan R.} and Parker, {David C.} and Cormier, {Damien C.}",
year = "2019",
month = "1",
day = "1",
doi = "10.1080/15377903.2019.1568334",
language = "English (US)",
journal = "Journal of Applied School Psychology",
issn = "1537-7903",
publisher = "Routledge",

}

An Examination of Interventionist Implementation Fidelity and Content Knowledge as Predictors of Math Intervention Effectiveness. / Nelson, Peter Marlow; Van Norman, Ethan R.; Parker, David C.; Cormier, Damien C.

In: Journal of Applied School Psychology, 01.01.2019.

Research output: Contribution to journalArticle

TY - JOUR

T1 - An Examination of Interventionist Implementation Fidelity and Content Knowledge as Predictors of Math Intervention Effectiveness

AU - Nelson, Peter Marlow

AU - Van Norman, Ethan R.

AU - Parker, David C.

AU - Cormier, Damien C.

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Data from a large-scale math intervention program were used to evaluate the degree to which implementation fidelity (IF) and interventionist content knowledge were associated with student outcomes. Data were available for 33 interventionists serving 658 students in Grades 4–6 across one school year. A series of multilevel models were fit to the data to evaluate the impact of procedural IF and interventionists’ math content knowledge on students’ postintervention achievement, controlling for preintervention achievement and intervention dosage. Higher student posttest scores were observed for interventionists with an average fidelity rating of 95% or greater (β =.15); however, no effects on students’ math achievement scores were observed for interventionist content knowledge. Adding IF and a measure of interventionist content knowledge to the model explained a statistically significant amount of variance in growth estimates attributable to interventionists (15%). Results highlight the potential importance of ongoing evaluation and remediation of IF in the context of standardized supplemental intervention in math, while also providing some evidence that higher levels of content knowledge may not translate into greater impact in a standard-protocol intervention setting. Results suggest a need for more research examining characteristics of interventionists and aspects of implementation that may account for variance in student outcomes.

AB - Data from a large-scale math intervention program were used to evaluate the degree to which implementation fidelity (IF) and interventionist content knowledge were associated with student outcomes. Data were available for 33 interventionists serving 658 students in Grades 4–6 across one school year. A series of multilevel models were fit to the data to evaluate the impact of procedural IF and interventionists’ math content knowledge on students’ postintervention achievement, controlling for preintervention achievement and intervention dosage. Higher student posttest scores were observed for interventionists with an average fidelity rating of 95% or greater (β =.15); however, no effects on students’ math achievement scores were observed for interventionist content knowledge. Adding IF and a measure of interventionist content knowledge to the model explained a statistically significant amount of variance in growth estimates attributable to interventionists (15%). Results highlight the potential importance of ongoing evaluation and remediation of IF in the context of standardized supplemental intervention in math, while also providing some evidence that higher levels of content knowledge may not translate into greater impact in a standard-protocol intervention setting. Results suggest a need for more research examining characteristics of interventionists and aspects of implementation that may account for variance in student outcomes.

UR - http://www.scopus.com/inward/record.url?scp=85062328653&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062328653&partnerID=8YFLogxK

U2 - 10.1080/15377903.2019.1568334

DO - 10.1080/15377903.2019.1568334

M3 - Article

AN - SCOPUS:85062328653

JO - Journal of Applied School Psychology

JF - Journal of Applied School Psychology

SN - 1537-7903

ER -