Family Medicine Clerkship Directors’ Perspectives on USMLE Pass/Fail Scoring: A CERA Study

Introduction: Reports on the effects of changing the United States Medical Licensing Exam (USMLE) Step 1 examination scoring to pass/fail are evolving in the medical literature. This Council of Academic Family Medicine Educational Research Alliance family medicine clerkship directors’ study seeks to describe family medicine clerkship directors’ perceptions on the impact of incorporation of Step 1 pass/fail score reporting on students’ family medicine clerkship performance. Methods: Ninety-six clerkship directors responded (56.8% response rate). After exclusion of Canadian schools, we analyzed 88 clerkship directors’ responses from US schools. We used descriptive statistics for demographics and responses to survey questions. We used χ² analysis to determine statistically significant associations between survey items. Results: Clerkship directors did not observe changes in students’ overall clinical performance after Step 1 pass/fail scoring (60.8%). Fifty percent of clerkship directors reported changes in Step 1 timing recommendations in the past 3 years. Reasons included curriculum redesign (30.5%), COVID (4.5%), change in Step 1 to pass/fail (11.0%), and other reasons (3.7%). Forty-five percent of these clerkship directors did not observe a change in students’ clinical medical knowledge after Step 1 went to pass/fail. Eighty-four percent of these clerkship directors did not compare student performance on clerkship standardized exams before and after Step 1 score changes. We found no significant relationship between Step 1 timing and student performance. Conclusions: This study represents an early description of family medicine clerkship directors’ perceived observations of the impact of Step 1 scoring changes on student performance. Continued investigation of the effects of USMLE Step 1 pass/fail scoring should occur.