Machine Learning and Statistical Analyses of Sensor Data Reveal Variability Between Repeated Trials in Parkinson's Disease Mobility Assessments

Sensors (Basel). 2024 Dec 19;24(24):8096. doi: 10.3390/s24248096.

Abstract

Mobility tasks like the Timed Up and Go test (TUG), cognitive TUG (cogTUG), and walking with turns provide insights into the impact of Parkinson's disease (PD) on motor control, balance, and cognitive function. We assess the test-retest reliability of these tasks in 262 PD participants and 50 controls by evaluating machine learning models based on wearable-sensor-derived measures and statistical metrics. This evaluation examines total duration, subtask duration, and other quantitative measures across two trials. We show that the diagnostic accuracy for distinguishing PD from controls decreases by a mean of 1.8% between the first and the second trial, suggesting that task repetition may not be necessary for accurate diagnosis. Although the total duration remains relatively consistent between trials (intraclass correlation coefficient (ICC) = 0.62 to 0.95), greater variability is seen in subtask duration and sensor-derived measures, reflected in machine learning performance and statistical differences. Our findings also show that this variability differs not only between controls and PD participants but also among groups with varying levels of PD severity, indicating the need to consider population characteristics. Relying solely on total task duration and conventional statistical metrics to gauge the reliability of mobility tasks may fail to reveal nuanced variations in movement.

Keywords: Parkinson’s disease; intraclass correlation coefficient; machine learning; mobility tasks; test–retest reliability; wearable sensors.

MeSH terms

  • Aged
  • Female
  • Humans
  • Machine Learning*
  • Male
  • Middle Aged
  • Movement / physiology
  • Parkinson Disease* / diagnosis
  • Parkinson Disease* / physiopathology
  • Postural Balance / physiology
  • Reproducibility of Results
  • Walking / physiology
  • Wearable Electronic Devices