Neurostatus e-Scoring improves consistency of Expanded Disability Status Scale assessments: A proof of concept study

Marcus D'Souza, Özgür Yaldizli, Roland John, Deborah R. Vogt, Athina Papadopoulou, Elisabeth Lucassen, Milena Menegola, Michaela Andelova, Frank Dahlke, Franz Schnyder, Ludwig Kappos

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

Background: To improve the consistency of standardized Expanded Disability Status Scale (EDSS) assessments, an electronic data capture tool and analysis tool was developed, Neurostatus e-Scoring (NESC). This tool allows real-time feedback by comparing entries with established scoring rules. Objective: To test whether using NESC reduces inconsistencies as compared to the paper-and-pencil version of the Expanded Disability Status Scale (pEDSS). Methods: In all, 100 multiple sclerosis (MS) patients were assessed in random order on the same day by pairs of neurologists, one using pEDSS and one NESC. We compared inter-rater reliability and frequency of inconsistencies in Neurostatus subscores, functional system (FS) scores, ambulation and EDSS steps. Results: Inconsistencies of any type were more likely to occur when using pEDSS (mean odds ratio (95% confidence interval (CI)) = 2.93 (1.62; 5.29)). This was also the case for FS score inconsistencies (2.54 (1.40; 4.61)) and more likely for patients in the lower EDSS range (≤3.5 vs >3.5) (5.32 (1.19; 23.77)). Overall, inter-rater agreement for the assessed Neurostatus subscores was high (median and inter-quartile range = 0.84 (0.73, 0.81)). Conclusion: Our data provide class II evidence that the use of NESC increases consistency of standardized EDSS assessments, and may thus have the potential to decrease noise and increase power of MS clinical trials.

Original languageEnglish (US)
Pages (from-to)597-603
Number of pages7
JournalMultiple Sclerosis
Volume23
Issue number4
DOIs
StatePublished - Jan 1 2017

Fingerprint

Multiple Sclerosis
Walking
Noise
Odds Ratio
Clinical Trials
Confidence Intervals
Neurologists

All Science Journal Classification (ASJC) codes

  • Neurology
  • Clinical Neurology

Cite this

D'Souza, M., Yaldizli, Ö., John, R., Vogt, D. R., Papadopoulou, A., Lucassen, E., ... Kappos, L. (2017). Neurostatus e-Scoring improves consistency of Expanded Disability Status Scale assessments: A proof of concept study. Multiple Sclerosis, 23(4), 597-603. https://doi.org/10.1177/1352458516657439
D'Souza, Marcus ; Yaldizli, Özgür ; John, Roland ; Vogt, Deborah R. ; Papadopoulou, Athina ; Lucassen, Elisabeth ; Menegola, Milena ; Andelova, Michaela ; Dahlke, Frank ; Schnyder, Franz ; Kappos, Ludwig. / Neurostatus e-Scoring improves consistency of Expanded Disability Status Scale assessments : A proof of concept study. In: Multiple Sclerosis. 2017 ; Vol. 23, No. 4. pp. 597-603.
@article{d840bae5b84f466f8e87847b1511256b,
title = "Neurostatus e-Scoring improves consistency of Expanded Disability Status Scale assessments: A proof of concept study",
abstract = "Background: To improve the consistency of standardized Expanded Disability Status Scale (EDSS) assessments, an electronic data capture tool and analysis tool was developed, Neurostatus e-Scoring (NESC). This tool allows real-time feedback by comparing entries with established scoring rules. Objective: To test whether using NESC reduces inconsistencies as compared to the paper-and-pencil version of the Expanded Disability Status Scale (pEDSS). Methods: In all, 100 multiple sclerosis (MS) patients were assessed in random order on the same day by pairs of neurologists, one using pEDSS and one NESC. We compared inter-rater reliability and frequency of inconsistencies in Neurostatus subscores, functional system (FS) scores, ambulation and EDSS steps. Results: Inconsistencies of any type were more likely to occur when using pEDSS (mean odds ratio (95{\%} confidence interval (CI)) = 2.93 (1.62; 5.29)). This was also the case for FS score inconsistencies (2.54 (1.40; 4.61)) and more likely for patients in the lower EDSS range (≤3.5 vs >3.5) (5.32 (1.19; 23.77)). Overall, inter-rater agreement for the assessed Neurostatus subscores was high (median and inter-quartile range = 0.84 (0.73, 0.81)). Conclusion: Our data provide class II evidence that the use of NESC increases consistency of standardized EDSS assessments, and may thus have the potential to decrease noise and increase power of MS clinical trials.",
author = "Marcus D'Souza and {\"O}zg{\"u}r Yaldizli and Roland John and Vogt, {Deborah R.} and Athina Papadopoulou and Elisabeth Lucassen and Milena Menegola and Michaela Andelova and Frank Dahlke and Franz Schnyder and Ludwig Kappos",
year = "2017",
month = "1",
day = "1",
doi = "10.1177/1352458516657439",
language = "English (US)",
volume = "23",
pages = "597--603",
journal = "Multiple Sclerosis",
issn = "1352-4585",
publisher = "SAGE Publications Ltd",
number = "4",

}

D'Souza, M, Yaldizli, Ö, John, R, Vogt, DR, Papadopoulou, A, Lucassen, E, Menegola, M, Andelova, M, Dahlke, F, Schnyder, F & Kappos, L 2017, 'Neurostatus e-Scoring improves consistency of Expanded Disability Status Scale assessments: A proof of concept study', Multiple Sclerosis, vol. 23, no. 4, pp. 597-603. https://doi.org/10.1177/1352458516657439

Neurostatus e-Scoring improves consistency of Expanded Disability Status Scale assessments : A proof of concept study. / D'Souza, Marcus; Yaldizli, Özgür; John, Roland; Vogt, Deborah R.; Papadopoulou, Athina; Lucassen, Elisabeth; Menegola, Milena; Andelova, Michaela; Dahlke, Frank; Schnyder, Franz; Kappos, Ludwig.

In: Multiple Sclerosis, Vol. 23, No. 4, 01.01.2017, p. 597-603.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Neurostatus e-Scoring improves consistency of Expanded Disability Status Scale assessments

T2 - A proof of concept study

AU - D'Souza, Marcus

AU - Yaldizli, Özgür

AU - John, Roland

AU - Vogt, Deborah R.

AU - Papadopoulou, Athina

AU - Lucassen, Elisabeth

AU - Menegola, Milena

AU - Andelova, Michaela

AU - Dahlke, Frank

AU - Schnyder, Franz

AU - Kappos, Ludwig

PY - 2017/1/1

Y1 - 2017/1/1

N2 - Background: To improve the consistency of standardized Expanded Disability Status Scale (EDSS) assessments, an electronic data capture tool and analysis tool was developed, Neurostatus e-Scoring (NESC). This tool allows real-time feedback by comparing entries with established scoring rules. Objective: To test whether using NESC reduces inconsistencies as compared to the paper-and-pencil version of the Expanded Disability Status Scale (pEDSS). Methods: In all, 100 multiple sclerosis (MS) patients were assessed in random order on the same day by pairs of neurologists, one using pEDSS and one NESC. We compared inter-rater reliability and frequency of inconsistencies in Neurostatus subscores, functional system (FS) scores, ambulation and EDSS steps. Results: Inconsistencies of any type were more likely to occur when using pEDSS (mean odds ratio (95% confidence interval (CI)) = 2.93 (1.62; 5.29)). This was also the case for FS score inconsistencies (2.54 (1.40; 4.61)) and more likely for patients in the lower EDSS range (≤3.5 vs >3.5) (5.32 (1.19; 23.77)). Overall, inter-rater agreement for the assessed Neurostatus subscores was high (median and inter-quartile range = 0.84 (0.73, 0.81)). Conclusion: Our data provide class II evidence that the use of NESC increases consistency of standardized EDSS assessments, and may thus have the potential to decrease noise and increase power of MS clinical trials.

AB - Background: To improve the consistency of standardized Expanded Disability Status Scale (EDSS) assessments, an electronic data capture tool and analysis tool was developed, Neurostatus e-Scoring (NESC). This tool allows real-time feedback by comparing entries with established scoring rules. Objective: To test whether using NESC reduces inconsistencies as compared to the paper-and-pencil version of the Expanded Disability Status Scale (pEDSS). Methods: In all, 100 multiple sclerosis (MS) patients were assessed in random order on the same day by pairs of neurologists, one using pEDSS and one NESC. We compared inter-rater reliability and frequency of inconsistencies in Neurostatus subscores, functional system (FS) scores, ambulation and EDSS steps. Results: Inconsistencies of any type were more likely to occur when using pEDSS (mean odds ratio (95% confidence interval (CI)) = 2.93 (1.62; 5.29)). This was also the case for FS score inconsistencies (2.54 (1.40; 4.61)) and more likely for patients in the lower EDSS range (≤3.5 vs >3.5) (5.32 (1.19; 23.77)). Overall, inter-rater agreement for the assessed Neurostatus subscores was high (median and inter-quartile range = 0.84 (0.73, 0.81)). Conclusion: Our data provide class II evidence that the use of NESC increases consistency of standardized EDSS assessments, and may thus have the potential to decrease noise and increase power of MS clinical trials.

UR - http://www.scopus.com/inward/record.url?scp=85018713649&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85018713649&partnerID=8YFLogxK

U2 - 10.1177/1352458516657439

DO - 10.1177/1352458516657439

M3 - Article

C2 - 27364325

AN - SCOPUS:85018713649

VL - 23

SP - 597

EP - 603

JO - Multiple Sclerosis

JF - Multiple Sclerosis

SN - 1352-4585

IS - 4

ER -