Abstract

Evaluators are challenged to keep pace with the vast array of Veteran support programs operating in the United States, resulting in a situation in which many programs lack any evidence of impact. Due to this lack of evidence, there is no efficient way to suggest which programs are most effective in helping Veterans in need of support. One potential solution to this dilemma is to reconceptualize program evaluation, by moving away from evaluating programs individually to evaluating what is common across programs. The Common Components Analysis (CCA) is one such technique that aggregates findings from programs that have undergone rigorous evaluation at the level of program components (e.g., content, process, barrier reduction). Given that many Veteran programs lack outcome evidence from rigorous studies, an adaptation to CCA is needed. This report examines cross-sectional data from a pilot study using an adapted CCA across five domains of well-being (i.e., employment, education, legal/financial/housing, mental/physical health, and social/personal relationships). The purpose of this preliminary study is to determine the feasibility of eliciting program nominations and program components from Veterans via an online survey. When coupled with a longitudinal research design, this adaptation to CCA will allow for stronger causal claims about the expected impact of different program components within and across a variety of domains.

LanguageEnglish (US)
Pages145-151
Number of pages7
JournalEvaluation and Program Planning
Volume72
DOIs
StatePublished - Feb 1 2019

Fingerprint

Veterans
Military
Program Evaluation
Mental Health
Research Design
Education
Common component
analysis
programme
lack
evidence
online survey
evaluation
research planning
well-being
housing
education

All Science Journal Classification (ASJC) codes

  • Business and International Management
  • Social Psychology
  • Geography, Planning and Development
  • Strategy and Management
  • Public Health, Environmental and Occupational Health

Cite this

@article{2b6def6328e24e79b1573e66c01ccd43,
title = "A novel approach for evaluating programs designed to serve military veterans: Using an adapted common components analysis",
abstract = "Evaluators are challenged to keep pace with the vast array of Veteran support programs operating in the United States, resulting in a situation in which many programs lack any evidence of impact. Due to this lack of evidence, there is no efficient way to suggest which programs are most effective in helping Veterans in need of support. One potential solution to this dilemma is to reconceptualize program evaluation, by moving away from evaluating programs individually to evaluating what is common across programs. The Common Components Analysis (CCA) is one such technique that aggregates findings from programs that have undergone rigorous evaluation at the level of program components (e.g., content, process, barrier reduction). Given that many Veteran programs lack outcome evidence from rigorous studies, an adaptation to CCA is needed. This report examines cross-sectional data from a pilot study using an adapted CCA across five domains of well-being (i.e., employment, education, legal/financial/housing, mental/physical health, and social/personal relationships). The purpose of this preliminary study is to determine the feasibility of eliciting program nominations and program components from Veterans via an online survey. When coupled with a longitudinal research design, this adaptation to CCA will allow for stronger causal claims about the expected impact of different program components within and across a variety of domains.",
author = "Richardson, {Cameron B.} and Morgan, {Nicole R.} and Bleser, {Julia A.} and Aronson, {Keith R.} and Perkins, {Daniel F.}",
year = "2019",
month = "2",
day = "1",
doi = "10.1016/j.evalprogplan.2018.10.012",
language = "English (US)",
volume = "72",
pages = "145--151",
journal = "Evaluation and Program Planning",
issn = "0149-7189",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - A novel approach for evaluating programs designed to serve military veterans

T2 - Evaluation and Program Planning

AU - Richardson, Cameron B.

AU - Morgan, Nicole R.

AU - Bleser, Julia A.

AU - Aronson, Keith R.

AU - Perkins, Daniel F.

PY - 2019/2/1

Y1 - 2019/2/1

N2 - Evaluators are challenged to keep pace with the vast array of Veteran support programs operating in the United States, resulting in a situation in which many programs lack any evidence of impact. Due to this lack of evidence, there is no efficient way to suggest which programs are most effective in helping Veterans in need of support. One potential solution to this dilemma is to reconceptualize program evaluation, by moving away from evaluating programs individually to evaluating what is common across programs. The Common Components Analysis (CCA) is one such technique that aggregates findings from programs that have undergone rigorous evaluation at the level of program components (e.g., content, process, barrier reduction). Given that many Veteran programs lack outcome evidence from rigorous studies, an adaptation to CCA is needed. This report examines cross-sectional data from a pilot study using an adapted CCA across five domains of well-being (i.e., employment, education, legal/financial/housing, mental/physical health, and social/personal relationships). The purpose of this preliminary study is to determine the feasibility of eliciting program nominations and program components from Veterans via an online survey. When coupled with a longitudinal research design, this adaptation to CCA will allow for stronger causal claims about the expected impact of different program components within and across a variety of domains.

AB - Evaluators are challenged to keep pace with the vast array of Veteran support programs operating in the United States, resulting in a situation in which many programs lack any evidence of impact. Due to this lack of evidence, there is no efficient way to suggest which programs are most effective in helping Veterans in need of support. One potential solution to this dilemma is to reconceptualize program evaluation, by moving away from evaluating programs individually to evaluating what is common across programs. The Common Components Analysis (CCA) is one such technique that aggregates findings from programs that have undergone rigorous evaluation at the level of program components (e.g., content, process, barrier reduction). Given that many Veteran programs lack outcome evidence from rigorous studies, an adaptation to CCA is needed. This report examines cross-sectional data from a pilot study using an adapted CCA across five domains of well-being (i.e., employment, education, legal/financial/housing, mental/physical health, and social/personal relationships). The purpose of this preliminary study is to determine the feasibility of eliciting program nominations and program components from Veterans via an online survey. When coupled with a longitudinal research design, this adaptation to CCA will allow for stronger causal claims about the expected impact of different program components within and across a variety of domains.

UR - http://www.scopus.com/inward/record.url?scp=85055016880&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85055016880&partnerID=8YFLogxK

U2 - 10.1016/j.evalprogplan.2018.10.012

DO - 10.1016/j.evalprogplan.2018.10.012

M3 - Article

VL - 72

SP - 145

EP - 151

JO - Evaluation and Program Planning

JF - Evaluation and Program Planning

SN - 0149-7189

ER -