Investigating the Effect of Simulator Functional Fidelity and Personalized Feedback on Central Venous Catheterization Training

Mary A. Yovanoff, Hong En Chen, David F. Pepley, Katelin A. Mirkin, David Han, Jason Zachary Moore, Scarlett Rae Miller

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Objective: To compare the effect of simulator functional fidelity (manikin vs a Dynamic Haptic Robotic Trainer [DHRT]) and personalized feedback on surgical resident self-efficacy and self-ratings of performance during ultrasound-guided internal jugular central venous catheterization (IJ CVC) training. In addition, we seek to explore how self-ratings of performance compare to objective performance scores generated by the DHRT system. Design: Participants were randomly assigned to either manikin or DHRT IJ CVC training over a 6-month period. Self-efficacy surveys were distributed before and following training. Training consisted of a pretest, 22 practice IJ CVC needle insertion attempts, 2 full-line practice attempts, and a posttest. Participants provided self-ratings of performance for each needle insertion and were presented with feedback from either an upper level resident (manikin) or a personalized learning system (DHRT). Setting: A study was conducted from July 2016 to February 2017 through a surgical skills training program at Hershey Medical Center in Hershey, Pennsylvania. Participants: Twenty-six first-year surgical residents were recruited for the study. Individuals were informed that IJ CVC training procedures would be consistent regardless of participation in the study and that participation was optional. All recruited residents opted to participate in the study. Results: Residents in both groups significantly improved their self-efficacy scores from pretest to posttest (p < 0.01). Residents in the manikin group consistently provided higher self-ratings of performance (p < 0.001). Residents in the DHRT group recorded more feedback on errors (228 instances) than the manikin group (144 instances). Self-ratings of performance on the DHRT system were able to significantly predict the objective score of the DHRT system (R 2 = 0.223, p < 0.001). Conclusion: Simulation training with the DHRT system and the personalized learning feedback can improve resident self-efficacy with IJ CVC procedures and provide sufficient feedback to allow residents to accurately assess their own performance.

Original languageEnglish (US)
Pages (from-to)1410-1421
Number of pages12
JournalJournal of surgical education
Volume75
Issue number5
DOIs
StatePublished - Sep 1 2018

Fingerprint

Central Venous Catheterization
Robotics
Manikins
resident
Self Efficacy
Neck
rating
self-efficacy
performance
Needles
Group
participation
learning
training program
Learning
Education

All Science Journal Classification (ASJC) codes

  • Surgery
  • Education

Cite this

@article{c68d822f1a0449cf9e79c9d20b4cadeb,
title = "Investigating the Effect of Simulator Functional Fidelity and Personalized Feedback on Central Venous Catheterization Training",
abstract = "Objective: To compare the effect of simulator functional fidelity (manikin vs a Dynamic Haptic Robotic Trainer [DHRT]) and personalized feedback on surgical resident self-efficacy and self-ratings of performance during ultrasound-guided internal jugular central venous catheterization (IJ CVC) training. In addition, we seek to explore how self-ratings of performance compare to objective performance scores generated by the DHRT system. Design: Participants were randomly assigned to either manikin or DHRT IJ CVC training over a 6-month period. Self-efficacy surveys were distributed before and following training. Training consisted of a pretest, 22 practice IJ CVC needle insertion attempts, 2 full-line practice attempts, and a posttest. Participants provided self-ratings of performance for each needle insertion and were presented with feedback from either an upper level resident (manikin) or a personalized learning system (DHRT). Setting: A study was conducted from July 2016 to February 2017 through a surgical skills training program at Hershey Medical Center in Hershey, Pennsylvania. Participants: Twenty-six first-year surgical residents were recruited for the study. Individuals were informed that IJ CVC training procedures would be consistent regardless of participation in the study and that participation was optional. All recruited residents opted to participate in the study. Results: Residents in both groups significantly improved their self-efficacy scores from pretest to posttest (p < 0.01). Residents in the manikin group consistently provided higher self-ratings of performance (p < 0.001). Residents in the DHRT group recorded more feedback on errors (228 instances) than the manikin group (144 instances). Self-ratings of performance on the DHRT system were able to significantly predict the objective score of the DHRT system (R 2 = 0.223, p < 0.001). Conclusion: Simulation training with the DHRT system and the personalized learning feedback can improve resident self-efficacy with IJ CVC procedures and provide sufficient feedback to allow residents to accurately assess their own performance.",
author = "Yovanoff, {Mary A.} and Chen, {Hong En} and Pepley, {David F.} and Mirkin, {Katelin A.} and David Han and Moore, {Jason Zachary} and Miller, {Scarlett Rae}",
year = "2018",
month = "9",
day = "1",
doi = "10.1016/j.jsurg.2018.02.018",
language = "English (US)",
volume = "75",
pages = "1410--1421",
journal = "Journal of Surgical Education",
issn = "1931-7204",
publisher = "Elsevier Inc.",
number = "5",

}

Investigating the Effect of Simulator Functional Fidelity and Personalized Feedback on Central Venous Catheterization Training. / Yovanoff, Mary A.; Chen, Hong En; Pepley, David F.; Mirkin, Katelin A.; Han, David; Moore, Jason Zachary; Miller, Scarlett Rae.

In: Journal of surgical education, Vol. 75, No. 5, 01.09.2018, p. 1410-1421.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Investigating the Effect of Simulator Functional Fidelity and Personalized Feedback on Central Venous Catheterization Training

AU - Yovanoff, Mary A.

AU - Chen, Hong En

AU - Pepley, David F.

AU - Mirkin, Katelin A.

AU - Han, David

AU - Moore, Jason Zachary

AU - Miller, Scarlett Rae

PY - 2018/9/1

Y1 - 2018/9/1

N2 - Objective: To compare the effect of simulator functional fidelity (manikin vs a Dynamic Haptic Robotic Trainer [DHRT]) and personalized feedback on surgical resident self-efficacy and self-ratings of performance during ultrasound-guided internal jugular central venous catheterization (IJ CVC) training. In addition, we seek to explore how self-ratings of performance compare to objective performance scores generated by the DHRT system. Design: Participants were randomly assigned to either manikin or DHRT IJ CVC training over a 6-month period. Self-efficacy surveys were distributed before and following training. Training consisted of a pretest, 22 practice IJ CVC needle insertion attempts, 2 full-line practice attempts, and a posttest. Participants provided self-ratings of performance for each needle insertion and were presented with feedback from either an upper level resident (manikin) or a personalized learning system (DHRT). Setting: A study was conducted from July 2016 to February 2017 through a surgical skills training program at Hershey Medical Center in Hershey, Pennsylvania. Participants: Twenty-six first-year surgical residents were recruited for the study. Individuals were informed that IJ CVC training procedures would be consistent regardless of participation in the study and that participation was optional. All recruited residents opted to participate in the study. Results: Residents in both groups significantly improved their self-efficacy scores from pretest to posttest (p < 0.01). Residents in the manikin group consistently provided higher self-ratings of performance (p < 0.001). Residents in the DHRT group recorded more feedback on errors (228 instances) than the manikin group (144 instances). Self-ratings of performance on the DHRT system were able to significantly predict the objective score of the DHRT system (R 2 = 0.223, p < 0.001). Conclusion: Simulation training with the DHRT system and the personalized learning feedback can improve resident self-efficacy with IJ CVC procedures and provide sufficient feedback to allow residents to accurately assess their own performance.

AB - Objective: To compare the effect of simulator functional fidelity (manikin vs a Dynamic Haptic Robotic Trainer [DHRT]) and personalized feedback on surgical resident self-efficacy and self-ratings of performance during ultrasound-guided internal jugular central venous catheterization (IJ CVC) training. In addition, we seek to explore how self-ratings of performance compare to objective performance scores generated by the DHRT system. Design: Participants were randomly assigned to either manikin or DHRT IJ CVC training over a 6-month period. Self-efficacy surveys were distributed before and following training. Training consisted of a pretest, 22 practice IJ CVC needle insertion attempts, 2 full-line practice attempts, and a posttest. Participants provided self-ratings of performance for each needle insertion and were presented with feedback from either an upper level resident (manikin) or a personalized learning system (DHRT). Setting: A study was conducted from July 2016 to February 2017 through a surgical skills training program at Hershey Medical Center in Hershey, Pennsylvania. Participants: Twenty-six first-year surgical residents were recruited for the study. Individuals were informed that IJ CVC training procedures would be consistent regardless of participation in the study and that participation was optional. All recruited residents opted to participate in the study. Results: Residents in both groups significantly improved their self-efficacy scores from pretest to posttest (p < 0.01). Residents in the manikin group consistently provided higher self-ratings of performance (p < 0.001). Residents in the DHRT group recorded more feedback on errors (228 instances) than the manikin group (144 instances). Self-ratings of performance on the DHRT system were able to significantly predict the objective score of the DHRT system (R 2 = 0.223, p < 0.001). Conclusion: Simulation training with the DHRT system and the personalized learning feedback can improve resident self-efficacy with IJ CVC procedures and provide sufficient feedback to allow residents to accurately assess their own performance.

UR - http://www.scopus.com/inward/record.url?scp=85044308589&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85044308589&partnerID=8YFLogxK

U2 - 10.1016/j.jsurg.2018.02.018

DO - 10.1016/j.jsurg.2018.02.018

M3 - Article

C2 - 29574019

AN - SCOPUS:85044308589

VL - 75

SP - 1410

EP - 1421

JO - Journal of Surgical Education

JF - Journal of Surgical Education

SN - 1931-7204

IS - 5

ER -