TY - JOUR
T1 - Initial testing of an electronic application of the simplified modified Rankin Scale questionnaire (e-smRSq)
AU - Dutta, Dipankar
AU - Foy, Chris
AU - Ramadurai, Gopinath
AU - Obaid, Mudhar
AU - Bruno, Askiel
PY - 2020/9
Y1 - 2020/9
N2 - Introduction and purpose: To facilitate modified Rankin scale (mRS) assessments, we developed and tested a smartphone/web application of the simplified mRS questionnaire (e-smRSq). The e-smRSq guides raters towards a final score according to the smRSq algorithm, and offers hints for scoring based on the conventional mRS concepts. Methods: Initially, three experienced mRS certified raters prepared 30 vignettes of unstructured stroke patient interviews, and determined consensus reference scores. Using the e-smRSq, 16 raters of varied professional backgrounds without mRS training scored the mRS for 24 randomly selected vignettes. Subsequently, 5 certified and 5 uncertified raters using the e-smRSq scored 23 mRS certification vignettes developed and used in the Strategies to Innovate Emergency Care Clinical Trials Network-Neurological Emergencies Treatment Trials (SIREN-NETT). Cohen's and Fleiss's kappa (κ), weighted kappa (κw), and intra-class correlation (ICC) compared rater scores with reference scores and assessed interrater reliability. Results: For the 16 initial raters using the e-smRSq with 24 vignettes, the κ (Fleiss) was 0.62 and ICC 0.87 (CI 0.80–0.93). Comparing raters’ scores with reference scores, Cohen's κ was 0.68 and κw 0.90. For the 10 subsequent raters using the e-smRSq on SIREN-NETT vignettes, κ (Fleiss) was 0.8 and ICC 0.95 (CI 0.91–0.97). Comparing all 10 raters scores with SIREN-NETT reference scores, Cohen's κ was 0.88 and κw 0.97. There was no significant difference between certified and uncertified raters. Conclusions: The e-smRSq appears to have good reproducibility and validity metrics among both certified and non-certified mRS raters, possibly owing to its simplicity. Further testing in stroke patients in warranted.
AB - Introduction and purpose: To facilitate modified Rankin scale (mRS) assessments, we developed and tested a smartphone/web application of the simplified mRS questionnaire (e-smRSq). The e-smRSq guides raters towards a final score according to the smRSq algorithm, and offers hints for scoring based on the conventional mRS concepts. Methods: Initially, three experienced mRS certified raters prepared 30 vignettes of unstructured stroke patient interviews, and determined consensus reference scores. Using the e-smRSq, 16 raters of varied professional backgrounds without mRS training scored the mRS for 24 randomly selected vignettes. Subsequently, 5 certified and 5 uncertified raters using the e-smRSq scored 23 mRS certification vignettes developed and used in the Strategies to Innovate Emergency Care Clinical Trials Network-Neurological Emergencies Treatment Trials (SIREN-NETT). Cohen's and Fleiss's kappa (κ), weighted kappa (κw), and intra-class correlation (ICC) compared rater scores with reference scores and assessed interrater reliability. Results: For the 16 initial raters using the e-smRSq with 24 vignettes, the κ (Fleiss) was 0.62 and ICC 0.87 (CI 0.80–0.93). Comparing raters’ scores with reference scores, Cohen's κ was 0.68 and κw 0.90. For the 10 subsequent raters using the e-smRSq on SIREN-NETT vignettes, κ (Fleiss) was 0.8 and ICC 0.95 (CI 0.91–0.97). Comparing all 10 raters scores with SIREN-NETT reference scores, Cohen's κ was 0.88 and κw 0.97. There was no significant difference between certified and uncertified raters. Conclusions: The e-smRSq appears to have good reproducibility and validity metrics among both certified and non-certified mRS raters, possibly owing to its simplicity. Further testing in stroke patients in warranted.
KW - Clinimetrics
KW - Modified Rankin scale
KW - Outcome assessment
KW - Stroke
UR - http://www.scopus.com/inward/record.url?scp=85086566002&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85086566002&partnerID=8YFLogxK
U2 - 10.1016/j.jstrokecerebrovasdis.2020.105024
DO - 10.1016/j.jstrokecerebrovasdis.2020.105024
M3 - Article
C2 - 32807439
AN - SCOPUS:85086566002
SN - 1052-3057
VL - 29
JO - Journal of Stroke and Cerebrovascular Diseases
JF - Journal of Stroke and Cerebrovascular Diseases
IS - 9
M1 - 105024
ER -