Training less-experienced faculty improves reliability of skills assessment in cardiac surgery
- Xiaoying Lou,
- ,
- Richard H. Feins,
- Daniel Enter,
- George L. Hicks,
- Edward D. Verrier
- Northwestern University,
- Saint Louis University,
- University of North Carolina at Chapel Hill,
- University of Rochester,
- University of Washington,
- Stanford University
Open access
Abstract
Objective Previous work has demonstrated high inter-rater reliability in the objective assessment of simulated anastomoses among experienced educators. We evaluated the inter-rater reliability of less-experienced educators and the impact of focused training with a video-embedded coronary anastomosis assessment tool.
Results All components of the assessment tool exhibited improvement in reliability, with 4 (bite, needle holder use, needle angles, and hand mechanics) improving the most from poor (ICC range, 0.09-0.48) to strong (ICC range, 0.80-0.90) agreement. After training, inter-rater reliabilities for composite scores improved from moderate (ICC, 0.76) to strong (ICC, 0.90) agreement, and for overall pass/fail ratings, from poor (kappa = 0.20) to moderate (kappa = 0.78) agreement.
Conclusions Focused, video-based anchor training facilitates greater inter-rater reliability in the objective assessment of simulated coronary anastomoses. Among raters with less teaching experience, such training may be needed before objective evaluation of technical skills.
Publication Information
Output type
Original language
English (US)Pages from-to (Number of pages)
Pages 2491-2496.e2Journal (Volume, Issue Number)
Journal of Thoracic and Cardiovascular Surgery (Volume 148, Issue 6)Publication milestones
- Published - 12/01/2014
Publication status
ISSN
0022-5223Publication IDs
- Scopus: 84920024046
- PubMed: 25308119