TY - JOUR
T1 - Script concordance testing
T2 - Assessing residents' clinical decision-making skills for infant lumbar punctures
AU - Chang, Todd P.
AU - Kessler, David
AU - McAninch, Brett
AU - Fein, Daniel M.
AU - Scherzer, D. J.
AU - Seelbach, Elizabeth
AU - Zaveri, Pavan
AU - Jackson, Jennifer M.
AU - Auerbach, Marc
AU - Mehta, Renuka
AU - Van Ittersum, Wendy
AU - Pusic, Martin V.
N1 - Copyright:
Copyright 2017 Elsevier B.V., All rights reserved.
PY - 2014/1
Y1 - 2014/1
N2 - PURPOSE: Residents must learn which infants require a lumbar puncture (LP), a clinical decision-making skill (CDMS) difficult to evaluate because of considerable practice variation. The authors created an assessment model of the CDMS to determine when an LP is indicated, taking practice variation into account. The objective was to detect whether script concordance testing (SCT) could measure CDMS competency among residents for performing infant LPs. METHOD: In 2011, using a modified Delphi technique, an expert panel of 14 attending physicians constructed 15 case vignettes (each with 2 to 4 SCT questions) that represented various infant LP scenarios. The authors distributed the vignettes to residents at 10 academic pediatric centers within the International Simulation in Pediatric Innovation, Research, and Education Network. They compared SCT scores among residents of different postgraduate years (PGYs), specialties, training in adult medicine, LP experience, and practice within an endemic Lyme disease area. RESULTS: Of 730 eligible residents, 102 completed 47 SCT questions. They could earn a maximum score of 47. Median SCT scores were significantly higher in PGY-3s compared with PGY-1s (difference: 3.0; 95% confidence interval [CI] 1.0-4.9; effect size d = 0.87). Scores also increased with increasing LP experience (difference: 3.3; 95% CI 1.1-5.5) and with adult medicine training (difference: 2.9; 95% CI 0.6-5.0). Residents in Lyme-endemic areas tended to perform more LPs than those in nonendemic areas. CONCLUSIONS: SCT questions may be useful as an assessment tool to determine CDMS competency among residents for performing infant LPs.
AB - PURPOSE: Residents must learn which infants require a lumbar puncture (LP), a clinical decision-making skill (CDMS) difficult to evaluate because of considerable practice variation. The authors created an assessment model of the CDMS to determine when an LP is indicated, taking practice variation into account. The objective was to detect whether script concordance testing (SCT) could measure CDMS competency among residents for performing infant LPs. METHOD: In 2011, using a modified Delphi technique, an expert panel of 14 attending physicians constructed 15 case vignettes (each with 2 to 4 SCT questions) that represented various infant LP scenarios. The authors distributed the vignettes to residents at 10 academic pediatric centers within the International Simulation in Pediatric Innovation, Research, and Education Network. They compared SCT scores among residents of different postgraduate years (PGYs), specialties, training in adult medicine, LP experience, and practice within an endemic Lyme disease area. RESULTS: Of 730 eligible residents, 102 completed 47 SCT questions. They could earn a maximum score of 47. Median SCT scores were significantly higher in PGY-3s compared with PGY-1s (difference: 3.0; 95% confidence interval [CI] 1.0-4.9; effect size d = 0.87). Scores also increased with increasing LP experience (difference: 3.3; 95% CI 1.1-5.5) and with adult medicine training (difference: 2.9; 95% CI 0.6-5.0). Residents in Lyme-endemic areas tended to perform more LPs than those in nonendemic areas. CONCLUSIONS: SCT questions may be useful as an assessment tool to determine CDMS competency among residents for performing infant LPs.
UR - http://www.scopus.com/inward/record.url?scp=84893712430&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84893712430&partnerID=8YFLogxK
U2 - 10.1097/ACM.0000000000000059
DO - 10.1097/ACM.0000000000000059
M3 - Article
C2 - 24280838
AN - SCOPUS:84893712430
SN - 1040-2446
VL - 89
SP - 128
EP - 135
JO - Academic Medicine
JF - Academic Medicine
IS - 1
ER -