A Bridge Too Far? Challenges in Evaluating Principal Effectiveness

Edward J. Fuller, Liz Hollingworth

Research output: Contribution to journalArticle

24 Citations (Scopus)

Abstract

Purpose: The purpose of this article is to examine the assumptions underlying efforts to evaluate principal effectiveness in terms of student test scores, to review extant research on efforts to estimate principal effectiveness, and to discuss the appropriateness of including estimates of principal effectiveness in evaluations of principals. Method: We review 10 different strategies for estimating principal effectiveness based on student test scores, representing all of the strategies currently employed by states and districts. We base our reviews on the literature in three areas: use of test scores, evaluation, and statistical approaches to estimating the effects of individuals and schools on student test scores. Conclusions: We conclude there are currently no strategies to estimate principal effectiveness that accurately capture the independent effect of principals on student test scores; thus, these current strategies send inaccurate signals to both principals and those who make employment decisions about principals. Moreover, we also conclude a substantial proportion of principals could not be included in the most accurate strategies to assess principal effectiveness. Implications: This research has profound implications for states and districts implementing principal evaluation systems, particularly those making high-stakes decisions about principals based on statistical estimates of principal effectiveness. Indeed, such statistical estimates should be used not for making judgments or decisions about principals but rather as a screening tool to identify where states and districts should focus more in-depth and accurate strategies to evaluate principal effectiveness.

Original languageEnglish (US)
Pages (from-to)466-499
Number of pages34
JournalEducational Administration Quarterly
Volume50
Issue number3
DOIs
StatePublished - Aug 2014

Fingerprint

district
student
evaluation
school
literature

All Science Journal Classification (ASJC) codes

  • Education
  • Public Administration

Cite this

@article{4b097198943c4d84b04162bdc5bd6658,
title = "A Bridge Too Far? Challenges in Evaluating Principal Effectiveness",
abstract = "Purpose: The purpose of this article is to examine the assumptions underlying efforts to evaluate principal effectiveness in terms of student test scores, to review extant research on efforts to estimate principal effectiveness, and to discuss the appropriateness of including estimates of principal effectiveness in evaluations of principals. Method: We review 10 different strategies for estimating principal effectiveness based on student test scores, representing all of the strategies currently employed by states and districts. We base our reviews on the literature in three areas: use of test scores, evaluation, and statistical approaches to estimating the effects of individuals and schools on student test scores. Conclusions: We conclude there are currently no strategies to estimate principal effectiveness that accurately capture the independent effect of principals on student test scores; thus, these current strategies send inaccurate signals to both principals and those who make employment decisions about principals. Moreover, we also conclude a substantial proportion of principals could not be included in the most accurate strategies to assess principal effectiveness. Implications: This research has profound implications for states and districts implementing principal evaluation systems, particularly those making high-stakes decisions about principals based on statistical estimates of principal effectiveness. Indeed, such statistical estimates should be used not for making judgments or decisions about principals but rather as a screening tool to identify where states and districts should focus more in-depth and accurate strategies to evaluate principal effectiveness.",
author = "Fuller, {Edward J.} and Liz Hollingworth",
year = "2014",
month = "8",
doi = "10.1177/0013161X13506595",
language = "English (US)",
volume = "50",
pages = "466--499",
journal = "Educational Administration Quarterly",
issn = "0013-161X",
publisher = "SAGE Publications Inc.",
number = "3",

}

A Bridge Too Far? Challenges in Evaluating Principal Effectiveness. / Fuller, Edward J.; Hollingworth, Liz.

In: Educational Administration Quarterly, Vol. 50, No. 3, 08.2014, p. 466-499.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A Bridge Too Far? Challenges in Evaluating Principal Effectiveness

AU - Fuller, Edward J.

AU - Hollingworth, Liz

PY - 2014/8

Y1 - 2014/8

N2 - Purpose: The purpose of this article is to examine the assumptions underlying efforts to evaluate principal effectiveness in terms of student test scores, to review extant research on efforts to estimate principal effectiveness, and to discuss the appropriateness of including estimates of principal effectiveness in evaluations of principals. Method: We review 10 different strategies for estimating principal effectiveness based on student test scores, representing all of the strategies currently employed by states and districts. We base our reviews on the literature in three areas: use of test scores, evaluation, and statistical approaches to estimating the effects of individuals and schools on student test scores. Conclusions: We conclude there are currently no strategies to estimate principal effectiveness that accurately capture the independent effect of principals on student test scores; thus, these current strategies send inaccurate signals to both principals and those who make employment decisions about principals. Moreover, we also conclude a substantial proportion of principals could not be included in the most accurate strategies to assess principal effectiveness. Implications: This research has profound implications for states and districts implementing principal evaluation systems, particularly those making high-stakes decisions about principals based on statistical estimates of principal effectiveness. Indeed, such statistical estimates should be used not for making judgments or decisions about principals but rather as a screening tool to identify where states and districts should focus more in-depth and accurate strategies to evaluate principal effectiveness.

AB - Purpose: The purpose of this article is to examine the assumptions underlying efforts to evaluate principal effectiveness in terms of student test scores, to review extant research on efforts to estimate principal effectiveness, and to discuss the appropriateness of including estimates of principal effectiveness in evaluations of principals. Method: We review 10 different strategies for estimating principal effectiveness based on student test scores, representing all of the strategies currently employed by states and districts. We base our reviews on the literature in three areas: use of test scores, evaluation, and statistical approaches to estimating the effects of individuals and schools on student test scores. Conclusions: We conclude there are currently no strategies to estimate principal effectiveness that accurately capture the independent effect of principals on student test scores; thus, these current strategies send inaccurate signals to both principals and those who make employment decisions about principals. Moreover, we also conclude a substantial proportion of principals could not be included in the most accurate strategies to assess principal effectiveness. Implications: This research has profound implications for states and districts implementing principal evaluation systems, particularly those making high-stakes decisions about principals based on statistical estimates of principal effectiveness. Indeed, such statistical estimates should be used not for making judgments or decisions about principals but rather as a screening tool to identify where states and districts should focus more in-depth and accurate strategies to evaluate principal effectiveness.

UR - http://www.scopus.com/inward/record.url?scp=84903377211&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84903377211&partnerID=8YFLogxK

U2 - 10.1177/0013161X13506595

DO - 10.1177/0013161X13506595

M3 - Article

AN - SCOPUS:84903377211

VL - 50

SP - 466

EP - 499

JO - Educational Administration Quarterly

JF - Educational Administration Quarterly

SN - 0013-161X

IS - 3

ER -