TY - JOUR
T1 - Level of agreement on health information technology adoption and use in survey data
T2 - A mixed-methods analysis of ambulatory clinics in 1 US state
AU - Rudin, Robert S.
AU - Shi, Yunfeng
AU - Fischer, Shira H.
AU - Shekelle, Paul
AU - Amill-Rosario, Alejandro
AU - Shaw, Bethany
AU - Ridgely, M. Susan
AU - Damberg, Cheryl L.
N1 - Publisher Copyright:
© The Author(s) 2019.
PY - 2019
Y1 - 2019
N2 - Objective: Adoption of health information technology (HIT) is often assessed in surveys of organizations. The validity of data from such surveys for ambulatory clinics has not been evaluated. We compared level of agreement between 1 ambulatory statewide survey and 2 other data sources: a second survey and interviews with survey respondents. Materials and methods: We used 2016 data from 2 surveys of ambulatory providers in Minnesota the Healthcare Information and Management Systems Society (HIMSS) survey and the Minnesota HIT Ambulatory Clinic Survey and primary data collected through qualitative interviews with survey respondents. We conducted a concurrent triangulation mixed-methods assessment of the Minnesota HIT survey by assessing level of agreement between it and HIMSS, and a thematic analysis of interview data to assess the respondent's understanding of what was being asked and their approach to responding. Results: We find high agreement between the 2 surveys on questions related to common HIT functionalities such as computerized provider order entry, medication-based decision support, and e-prescribing which were widely adopted by respondents' organizations. Qualitative data suggest respondents found wording of items about these functionalities clear but encountered multiple challenges including interpreting items for less commonly adopted functionalities, estimating degree of HIT usage, and indicating relevant barriers. Respondents identified multiple errors in responses and likely reported greater within-group homogeneity than actually existed. Conclusions: Survey items related to the presence or absence of widely adopted HIT functionalities may be more valid than items about less common functionalities, degree of usage, and barriers.
AB - Objective: Adoption of health information technology (HIT) is often assessed in surveys of organizations. The validity of data from such surveys for ambulatory clinics has not been evaluated. We compared level of agreement between 1 ambulatory statewide survey and 2 other data sources: a second survey and interviews with survey respondents. Materials and methods: We used 2016 data from 2 surveys of ambulatory providers in Minnesota the Healthcare Information and Management Systems Society (HIMSS) survey and the Minnesota HIT Ambulatory Clinic Survey and primary data collected through qualitative interviews with survey respondents. We conducted a concurrent triangulation mixed-methods assessment of the Minnesota HIT survey by assessing level of agreement between it and HIMSS, and a thematic analysis of interview data to assess the respondent's understanding of what was being asked and their approach to responding. Results: We find high agreement between the 2 surveys on questions related to common HIT functionalities such as computerized provider order entry, medication-based decision support, and e-prescribing which were widely adopted by respondents' organizations. Qualitative data suggest respondents found wording of items about these functionalities clear but encountered multiple challenges including interpreting items for less commonly adopted functionalities, estimating degree of HIT usage, and indicating relevant barriers. Respondents identified multiple errors in responses and likely reported greater within-group homogeneity than actually existed. Conclusions: Survey items related to the presence or absence of widely adopted HIT functionalities may be more valid than items about less common functionalities, degree of usage, and barriers.
UR - http://www.scopus.com/inward/record.url?scp=85092497723&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85092497723&partnerID=8YFLogxK
U2 - 10.1093/jamiaopen/ooz004
DO - 10.1093/jamiaopen/ooz004
M3 - Article
AN - SCOPUS:85092497723
VL - 2
SP - 231
EP - 237
JO - JAMIA Open
JF - JAMIA Open
SN - 2574-2531
IS - 2
ER -