TY - JOUR
T1 - Measuring the quality of Patients' goals and action plans
T2 - Development and validation of a novel tool
AU - Teal, Cayla R.
AU - Haidet, Paul
AU - Balasubramanyam, Ajay S.
AU - Rodriguez, Elisa
AU - Naik, Aanand D.
N1 - Funding Information:
The authors wish to thank Andrea Price, BA, at the UT MD Anderson Cancer Center and Kristin Cassidy, BA, at the Houston Health Services Research and Development Center of Excellence for their assistance with patient recruitment, retention and project support; Jose Polo, MD and Sagar Sardesai, MD, MPH at the UT MD Anderson Cancer Center for serving as project raters; and Annette Walder, MS at the Houston Health Services Research and Development Center of Excellence for assistance with data analysis. Preliminary findings from this study were presented at the 2009 International Conference on Communication in Healthcare, Miami Beach, Florida, October 6, 2009. The authors acknowledge project support from a Clinical Scientist Development Award from the Doris Duke Charitable Foundation (Naik, PI and Teal, Co-I) for the development and validation of the GET-D. Data for this study arises from a core demonstration project of the Houston Center for Research and Education on Therapeutics (Houston CERT, Suarez-Almazor, PI) supported by a grant from the Agency for Healthcare Research and Quality (#U18HS016093). Additional support and/or resources in the preparation of this manuscript were provided by the Houston Health Services Research and Development Center of Excellence (HFP90-020) at the Michael E. DeBakey VA Medical Center. Dr. Naik receives additional support from the National Institute on Aging (K23AG027144). These sources had no role in the preparation, review, or approval of the manuscript.
PY - 2012
Y1 - 2012
N2 - Background: The purpose of this study is to develop and test reliability, validity, and utility of the Goal-Setting Evaluation Tool for Diabetes (GET-D). The effectiveness of diabetes self-management is predicated on goal-setting and action planning strategies. Evaluation of self-management interventions is hampered by the absence of tools to assess quality of goals and action plans. To address this gap, we developed the GET-D, a criteria-based, observer rating scale that measures the quality of patients' diabetes goals and action plans. Methods. We conducted 3-stage development of GET-D, including identification of criteria for observer ratings of goals and action plans, rater training and pilot testing; and then performed psychometric testing of the GET-D. Results: Trained raters could effectively rate the quality of patient-generated goals and action plans using the GET-D. Ratings performed by trained evaluators demonstrated good raw agreement (94.4%) and inter-rater reliability (Kappa = 0.66). Scores on the GET-D correlated well with measures theoretically associated with goal-setting, including patient activation (r=.252, P<.05), diabetes specific self-efficacy (r=.376, P<.001) and inverse relationship with depression (r= -.376, P<.01). Significant between group differences (P<.01) in GET-D scores between goal-setting intervention (mean = 7.33, standard deviation = 4.4) and education groups (mean = 4.93, standard deviation = 3.9) confirmed construct validity of the GET-D. Conclusions: The GET-D can reliably and validly rate the quality of goals and action plans. It holds promise as a measure of intervention fidelity for clinical interventions that promote diabetes self-management behaviors to improve clinical outcomes. Trial registration. Clinicaltrials.gov Identifier: NCT00481286.
AB - Background: The purpose of this study is to develop and test reliability, validity, and utility of the Goal-Setting Evaluation Tool for Diabetes (GET-D). The effectiveness of diabetes self-management is predicated on goal-setting and action planning strategies. Evaluation of self-management interventions is hampered by the absence of tools to assess quality of goals and action plans. To address this gap, we developed the GET-D, a criteria-based, observer rating scale that measures the quality of patients' diabetes goals and action plans. Methods. We conducted 3-stage development of GET-D, including identification of criteria for observer ratings of goals and action plans, rater training and pilot testing; and then performed psychometric testing of the GET-D. Results: Trained raters could effectively rate the quality of patient-generated goals and action plans using the GET-D. Ratings performed by trained evaluators demonstrated good raw agreement (94.4%) and inter-rater reliability (Kappa = 0.66). Scores on the GET-D correlated well with measures theoretically associated with goal-setting, including patient activation (r=.252, P<.05), diabetes specific self-efficacy (r=.376, P<.001) and inverse relationship with depression (r= -.376, P<.01). Significant between group differences (P<.01) in GET-D scores between goal-setting intervention (mean = 7.33, standard deviation = 4.4) and education groups (mean = 4.93, standard deviation = 3.9) confirmed construct validity of the GET-D. Conclusions: The GET-D can reliably and validly rate the quality of goals and action plans. It holds promise as a measure of intervention fidelity for clinical interventions that promote diabetes self-management behaviors to improve clinical outcomes. Trial registration. Clinicaltrials.gov Identifier: NCT00481286.
UR - http://www.scopus.com/inward/record.url?scp=84871572135&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84871572135&partnerID=8YFLogxK
U2 - 10.1186/1472-6947-12-152
DO - 10.1186/1472-6947-12-152
M3 - Article
C2 - 23270422
AN - SCOPUS:84871572135
VL - 12
JO - BMC Medical Informatics and Decision Making
JF - BMC Medical Informatics and Decision Making
SN - 1472-6947
IS - 1
M1 - 152
ER -