Integrating Validity Evidence to Revise a Child Abuse Knowledge Test for Early Childhood Education Providers: A Mixed Methods Approach

Carlomagno C. Panlilio, Lisa Famularo, Jessica Masters, Sarah Dore, Nicole Verdiglione, Chengwu Yang, Erik Lehman, Robert M. Hamm, Richard Fiene, David Bard, Karl M. Kapp, Benjamin H. Levi

Research output: Contribution to journalArticlepeer-review


Knowledge tests used to evaluate child protection training program effectiveness for early childhood education providers may suffer from threats to construct validity given the contextual variability inherent within state-specific regulations around mandated reporting requirements. Unfortunately, guidance on instrument revision that accounts for such state-specific mandated reporting requirements is lacking across research on evaluation practices. This study, therefore, explored how collection and integration of validity evidence using a mixed methods framework can guide the instrument revision process to arrive at a more valid program outcome measure.

Original languageEnglish (US)
JournalAmerican Journal of Evaluation
StateAccepted/In press - 2021

All Science Journal Classification (ASJC) codes

  • Business and International Management
  • Social Psychology
  • Health(social science)
  • Education
  • Sociology and Political Science
  • Strategy and Management

Cite this