TY - JOUR
T1 - Considering Network Effects in the Design and Analysis of Field Experiments on State Legislatures
AU - Phadke, Sayali
AU - Desmarais, Bruce A.
N1 - Funding Information:
The author(s) disclosed receipt of the following financial support for research, authorship, and/or publication of this article: Work supported in part by National Science Foundation grants SES-1558661, SES-1619644, CISE-1320219, SES-1637089, SES-0752986 and IGERT Grant DGE-1144860, Big Data Social Science. Any opinions, findings, and conclusions or recommendations are those of the authors and do not necessarily reflect those of the sponsor.
Publisher Copyright:
© The Author(s) 2019.
PY - 2019/12/1
Y1 - 2019/12/1
N2 - Recent work on legislative politics has documented complex patterns of interaction and collaboration through the lens of network analysis. In a largely separate vein of research, the field experiment—with many applications in state legislatures—has emerged as an important approach in establishing causal identification in the study of legislative politics. The stable unit treatment value assumption (SUTVA)—the assumption that a unit’s outcome is unaffected by other units’ treatment statuses—is required in conventional approaches to causal inference with experiments. When SUTVA is violated via networked social interaction, treatment effects spread to control units through the network structure. We review recently developed methods that can be used to account for interference in the analysis of data from field experiments on state legislatures. The methods we review require the researcher to specify a spillover model, according to which legislators influence each other, and specify the network through which spillover occurs. We discuss these and other specification steps in detail. We find mixed evidence for spillover effects in data from two previously published field experiments. Our replication analyses illustrate how researchers can use recently developed methods to test for interference effects, and support the case for considering interference effects in experiments on state legislatures.
AB - Recent work on legislative politics has documented complex patterns of interaction and collaboration through the lens of network analysis. In a largely separate vein of research, the field experiment—with many applications in state legislatures—has emerged as an important approach in establishing causal identification in the study of legislative politics. The stable unit treatment value assumption (SUTVA)—the assumption that a unit’s outcome is unaffected by other units’ treatment statuses—is required in conventional approaches to causal inference with experiments. When SUTVA is violated via networked social interaction, treatment effects spread to control units through the network structure. We review recently developed methods that can be used to account for interference in the analysis of data from field experiments on state legislatures. The methods we review require the researcher to specify a spillover model, according to which legislators influence each other, and specify the network through which spillover occurs. We discuss these and other specification steps in detail. We find mixed evidence for spillover effects in data from two previously published field experiments. Our replication analyses illustrate how researchers can use recently developed methods to test for interference effects, and support the case for considering interference effects in experiments on state legislatures.
UR - http://www.scopus.com/inward/record.url?scp=85068901116&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85068901116&partnerID=8YFLogxK
U2 - 10.1177/1532440019859819
DO - 10.1177/1532440019859819
M3 - Article
AN - SCOPUS:85068901116
VL - 19
SP - 451
EP - 473
JO - State Politics and Policy Quarterly
JF - State Politics and Policy Quarterly
SN - 1532-4400
IS - 4
ER -