On the Importance of Treatment Effect Heterogeneity in Experimentally-Evaluated Criminal Justice Interventions

Chongmin Na, Thomas Loughran, Raymond Paternoster

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Objectives: This paper aims to suggest a framework to think of a more practical way to consider the broader impact of a program intervention beyond just its average, by considering the concept of treatment effect heterogeneity—how the same intervention may produce differential effects for different subgroups of individuals. Methods: Using an application of data on an experimental intervention from the Johns Hopkins Prevention Intervention Research Center, the current study demonstrates the contribution of more general growth mixture modeling approaches, such as Group-Based Trajectory Model (Nagin in Group-based modeling of development. Harvard University Press, Cambridge, 2005) and growth mixture modeling (Muthén in New developments and techniques in structural equation modeling. Lawrence Erlbaum Associates, Mahwah, pp 1–33, 2001) for assessing meaningful heterogeneous effects of a treatment across clusters or classes of individuals following distinct patterns of development over time. Results: The findings demonstrate how population-averaged treatment effects might underestimate substantively meaningful localized effects among more theoretically and policy relevant subgroups of individuals such as those with non-normative growth (high–low) and those with more room for improvement (low–low) in the development of self-control. Conclusions: We are calling for the assessment of a program in terms of both average and localized effects because we might wrongfully conclude that a given program is not effective when it in fact has a great impact, but only on the segments of population who need it the most.

Original languageEnglish (US)
Pages (from-to)289-310
Number of pages22
JournalJournal of Quantitative Criminology
Volume31
Issue number2
DOIs
StatePublished - Jun 1 2015

Fingerprint

Criminal Law
justice
Growth
Population
self-control
Research
Group

All Science Journal Classification (ASJC) codes

  • Pathology and Forensic Medicine
  • Law

Cite this

@article{bf5e5dccd0324a7d88bae7010696c4b9,
title = "On the Importance of Treatment Effect Heterogeneity in Experimentally-Evaluated Criminal Justice Interventions",
abstract = "Objectives: This paper aims to suggest a framework to think of a more practical way to consider the broader impact of a program intervention beyond just its average, by considering the concept of treatment effect heterogeneity—how the same intervention may produce differential effects for different subgroups of individuals. Methods: Using an application of data on an experimental intervention from the Johns Hopkins Prevention Intervention Research Center, the current study demonstrates the contribution of more general growth mixture modeling approaches, such as Group-Based Trajectory Model (Nagin in Group-based modeling of development. Harvard University Press, Cambridge, 2005) and growth mixture modeling (Muth{\'e}n in New developments and techniques in structural equation modeling. Lawrence Erlbaum Associates, Mahwah, pp 1–33, 2001) for assessing meaningful heterogeneous effects of a treatment across clusters or classes of individuals following distinct patterns of development over time. Results: The findings demonstrate how population-averaged treatment effects might underestimate substantively meaningful localized effects among more theoretically and policy relevant subgroups of individuals such as those with non-normative growth (high–low) and those with more room for improvement (low–low) in the development of self-control. Conclusions: We are calling for the assessment of a program in terms of both average and localized effects because we might wrongfully conclude that a given program is not effective when it in fact has a great impact, but only on the segments of population who need it the most.",
author = "Chongmin Na and Thomas Loughran and Raymond Paternoster",
year = "2015",
month = "6",
day = "1",
doi = "10.1007/s10940-014-9245-2",
language = "English (US)",
volume = "31",
pages = "289--310",
journal = "Journal of Quantitative Criminology",
issn = "0748-4518",
publisher = "Springer New York",
number = "2",

}

On the Importance of Treatment Effect Heterogeneity in Experimentally-Evaluated Criminal Justice Interventions. / Na, Chongmin; Loughran, Thomas; Paternoster, Raymond.

In: Journal of Quantitative Criminology, Vol. 31, No. 2, 01.06.2015, p. 289-310.

Research output: Contribution to journalArticle

TY - JOUR

T1 - On the Importance of Treatment Effect Heterogeneity in Experimentally-Evaluated Criminal Justice Interventions

AU - Na, Chongmin

AU - Loughran, Thomas

AU - Paternoster, Raymond

PY - 2015/6/1

Y1 - 2015/6/1

N2 - Objectives: This paper aims to suggest a framework to think of a more practical way to consider the broader impact of a program intervention beyond just its average, by considering the concept of treatment effect heterogeneity—how the same intervention may produce differential effects for different subgroups of individuals. Methods: Using an application of data on an experimental intervention from the Johns Hopkins Prevention Intervention Research Center, the current study demonstrates the contribution of more general growth mixture modeling approaches, such as Group-Based Trajectory Model (Nagin in Group-based modeling of development. Harvard University Press, Cambridge, 2005) and growth mixture modeling (Muthén in New developments and techniques in structural equation modeling. Lawrence Erlbaum Associates, Mahwah, pp 1–33, 2001) for assessing meaningful heterogeneous effects of a treatment across clusters or classes of individuals following distinct patterns of development over time. Results: The findings demonstrate how population-averaged treatment effects might underestimate substantively meaningful localized effects among more theoretically and policy relevant subgroups of individuals such as those with non-normative growth (high–low) and those with more room for improvement (low–low) in the development of self-control. Conclusions: We are calling for the assessment of a program in terms of both average and localized effects because we might wrongfully conclude that a given program is not effective when it in fact has a great impact, but only on the segments of population who need it the most.

AB - Objectives: This paper aims to suggest a framework to think of a more practical way to consider the broader impact of a program intervention beyond just its average, by considering the concept of treatment effect heterogeneity—how the same intervention may produce differential effects for different subgroups of individuals. Methods: Using an application of data on an experimental intervention from the Johns Hopkins Prevention Intervention Research Center, the current study demonstrates the contribution of more general growth mixture modeling approaches, such as Group-Based Trajectory Model (Nagin in Group-based modeling of development. Harvard University Press, Cambridge, 2005) and growth mixture modeling (Muthén in New developments and techniques in structural equation modeling. Lawrence Erlbaum Associates, Mahwah, pp 1–33, 2001) for assessing meaningful heterogeneous effects of a treatment across clusters or classes of individuals following distinct patterns of development over time. Results: The findings demonstrate how population-averaged treatment effects might underestimate substantively meaningful localized effects among more theoretically and policy relevant subgroups of individuals such as those with non-normative growth (high–low) and those with more room for improvement (low–low) in the development of self-control. Conclusions: We are calling for the assessment of a program in terms of both average and localized effects because we might wrongfully conclude that a given program is not effective when it in fact has a great impact, but only on the segments of population who need it the most.

UR - http://www.scopus.com/inward/record.url?scp=84940001930&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84940001930&partnerID=8YFLogxK

U2 - 10.1007/s10940-014-9245-2

DO - 10.1007/s10940-014-9245-2

M3 - Article

AN - SCOPUS:84940001930

VL - 31

SP - 289

EP - 310

JO - Journal of Quantitative Criminology

JF - Journal of Quantitative Criminology

SN - 0748-4518

IS - 2

ER -