TY - JOUR
T1 - Let's get technical
T2 - Enhancing program evaluation through the use and integration of internet and mobile technologies
AU - Materia, Frank T.
AU - Miller, Elizabeth A.
AU - Runion, Megan C.
AU - Chesnut, Ryan P.
AU - Irvin, Jamie B.
AU - Richardson, Cameron B.
AU - Perkins, Daniel F.
N1 - Funding Information:
This material is the result of a partnership jointly funded by: The Department of Defense between the Office of the Deputy Assistant Secretary of Defense for Military Community and Family Policy and the USDA’s National Institute of Food and Agriculture through a grant/cooperative agreement with Penn State University & The NAVAL SEA SYSTEMS COMMAND (NAVSEA) under Contract No. N00024-12-D-6404 , Task Order #0239 developed in collaboration with Penn State University .
Publisher Copyright:
© 2016 Elsevier Ltd.
PY - 2016/6/1
Y1 - 2016/6/1
N2 - Program evaluation has become increasingly important, and information on program performance often drives funding decisions. Technology use and integration can help ease the burdens associated with program evaluation by reducing the resources needed (e.g., time, money, staff) and increasing evaluation efficiency. This paper reviews how program evaluators, across disciplines, can apply internet and mobile technologies to key aspects of program evaluation, which consist of participant registration, participant tracking and retention, process evaluation (e.g., fidelity, assignment completion), and outcome evaluation (e.g., behavior change, knowledge gain). In addition, the paper focuses on the ease of use, relative cost, and fit with populations. An examination on how these tools can be integrated to enhance data collection and program evaluation is discussed. Important limitations of and considerations for technology integration, including the level of technical skill, cost needed to integrate various technologies, data management strategies, and ethical considerations, are highlighted. Lastly, a case study of technology use in an evaluation conducted by the Clearinghouse for Military Family Readiness at Penn State is presented and illustrates how technology integration can enhance program evaluation.
AB - Program evaluation has become increasingly important, and information on program performance often drives funding decisions. Technology use and integration can help ease the burdens associated with program evaluation by reducing the resources needed (e.g., time, money, staff) and increasing evaluation efficiency. This paper reviews how program evaluators, across disciplines, can apply internet and mobile technologies to key aspects of program evaluation, which consist of participant registration, participant tracking and retention, process evaluation (e.g., fidelity, assignment completion), and outcome evaluation (e.g., behavior change, knowledge gain). In addition, the paper focuses on the ease of use, relative cost, and fit with populations. An examination on how these tools can be integrated to enhance data collection and program evaluation is discussed. Important limitations of and considerations for technology integration, including the level of technical skill, cost needed to integrate various technologies, data management strategies, and ethical considerations, are highlighted. Lastly, a case study of technology use in an evaluation conducted by the Clearinghouse for Military Family Readiness at Penn State is presented and illustrates how technology integration can enhance program evaluation.
UR - http://www.scopus.com/inward/record.url?scp=84961859267&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84961859267&partnerID=8YFLogxK
U2 - 10.1016/j.evalprogplan.2016.03.004
DO - 10.1016/j.evalprogplan.2016.03.004
M3 - Article
C2 - 27018831
AN - SCOPUS:84961859267
SN - 0149-7189
VL - 56
SP - 31
EP - 42
JO - Evaluation and Program Planning
JF - Evaluation and Program Planning
ER -