MSCopilot, a new multiple sclerosis self-assessment digital solution: results of a comparative study versus standard tests

Eur J Neurol. 2020 Mar;27(3):429-436. doi: 10.1111/ene.14091. Epub 2019 Oct 19.

Abstract

Background and purpose: Assessing patients' disability in multiple sclerosis (MS) requires time-consuming batteries of hospital tests. MSCopilot is a software medical device for the self-assessment of patients with MS (PwMS), combining four tests: walking, dexterity, cognition and low contrast vision. The objective was to validate MSCopilot versus the Multiple Sclerosis Functional Composite (MSFC).

Methods: This multicentre, open-label, randomized, controlled, crossover study enrolled 141 PwMS and 76 healthy controls (HCs). All participants performed MSCopilot and MSFC tests at day 0. To assess reproducibility, 46 PwMS performed the same tests at day 30 ± 3. The primary end-point was the validation of MSCopilot versus MSFC for the identification of PwMS against HCs, quantified using the area under the curve (AUC). The main secondary end-point was the correlation of MSCopilot z-scores with MSFC z-scores.

Results: In all, 116 PwMS and 69 HCs were analysed. The primary end-point was achieved: MSCopilot performance was non-inferior to that of MSFC (AUC 0.92 and 0.89 respectively; P = 0.3). MSCopilot and MSFC discriminated PwMS and HCs with 81% and 76% sensitivity and 82% and 88% specificity respectively. Digital and standard test scores were highly correlated (r = 0.81; P < 0.001). The test-retest study demonstrated the good reproducibility of MSCopilot.

Conclusion: This study confirms the reliability of MSCopilot and its usability in clinical practice for the monitoring of MS-related disability.

Keywords: Multiple Sclerosis Functional Composite (MSFC); eHealth; health information technology; mobile application; multiple sclerosis; reliability; smartphone app; validity.

Publication types

  • Comparative Study
  • Multicenter Study
  • Randomized Controlled Trial
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Aged
  • Cognition / physiology*
  • Cross-Over Studies
  • Diagnostic Self Evaluation*
  • Disability Evaluation*
  • Female
  • Humans
  • Male
  • Middle Aged
  • Motor Skills / physiology*
  • Multiple Sclerosis / diagnosis*
  • Multiple Sclerosis / physiopathology
  • Reference Standards
  • Reproducibility of Results
  • Symptom Assessment
  • Vision, Ocular / physiology*
  • Walking / physiology*
  • Young Adult