Study Objective To develop and validate a procedure-specific scoring algorithm to objectively measure robotic surgical skills during robot-assisted hysterectomy and to facilitate robotic surgery training and education. Design (Canadian Task Force classification III). Setting A National Comprehensive Cancer Network–designated comprehensive cancer center. Patients Deidentified videos for robot-assisted hysterectomies were evaluated. Interventions Videos from 26 robotic hysterectomies performed by surgeons with varying degrees of experience using the scoring system were evaluated. In phase I, critical elements of a robotic hysterectomy were deconstructed into 6 key domains to assess technical skills for procedure completion. Anchor descriptions were developed for each domain to match a 5-point Likert scale. Delphi methodology was used for content validation. A panel of 5 expert robotic surgeons refined this scoring system. In phase II, video recordings of procedures performed by surgeons with varying degrees of experience (expert, advanced beginner, and novice) were evaluated by blinded expert reviewers using the scoring system. Descriptive statistics were used to summarize the scores for each domain. Intraclass correlation was used to determine the interrater reliability. A p value <.05 was considered significant. Measurements and Main Results The average score for the 3 classes of surgeon was 75.6 for expert, 71.3 for advanced beginner, and 69.0 for novice (p = .006). There were significant differences in scores of most individual domains among the various classes of surgeons. Novice surgeons took significantly longer than expert surgeons to complete their half of a hysterectomy (22.2 vs 12.0 minutes; p = .001). Conclusion This pilot study demonstrates the feasibility of using a standardized rubric for clinical skills assessment in robotic hysterectomy. Blinded expert reviewers were able to differentiate between varying levels of surgical experience using this assessment tool.
All Science Journal Classification (ASJC) codes
- Obstetrics and Gynecology