Back

Artificial Intelligence to Predict Functional Status after Acute Stroke Symptoms From Wrist Accelerometry Devices

Kummer, B. R.; Gerlach, A.; Kohli, S.; Willey, J. Z.; Shechter, A.; Liebeskind, D. S.; Nadkarni, G.

2025-04-04 neurology
10.1101/2025.04.03.25325214 medRxiv
Show abstract

BackgroundFunctional outcomes after stroke are commonly assessed via modified Rankin Scale (mRS). However, mRS is subject to patient and assessor biases and is impractical to collect in many cases, limiting its impact on post-stroke care. Artificial intelligence (AI) applied to wrist-worn triaxial accelerometry (WWTA) device data can objectively characterize post-stroke functional status and related changes. MethodsWe used patient data from REACH Stroke-Sleep, a study investigating WWTA-derived measures of sleep, physical activity, and recurrent stroke risk among patients with acute stroke symptoms. We determined moving accelerometry averages and vector sums over four time windows (minute, hour, day, week). We trained a tree-based (random forest; RF) and deep learning (LSTM) model to predict individual 6-month mRS scores and differences between 1- and 6-month mRS scores. We used 5-fold cross validation, modeled each outcome as binary exact-match between actual-predicted values, and determined area under the receiver-operating curve (AUROC), sensitivity, precision, negative predictive value, and F1 scores for both models. For mRS score differences, we determined mean absolute error (MAE) and standard deviation (SD). ResultsWe identified 362 patients in REACH Stroke-Sleep, of whom 302 (83.4%) had a 1-month mRS score, 251 (69.3%) had a 6-month mRS score, and 191 (52.8%) had both. Patients wore devices for median 41.0 (IQR 34.4-44.0) days. For all outcomes, RF models (6-month AUROC 0.81, 95%CI 0.74- 0.89; 1-6 month mRS AUROC 0.82, 95%CI 0.76-0.90) outperformed LSTM models (6-month AUROC 0.63, 95%CI 0.55-0.71; 1-6 month mRS AUROC 0.53, 95%CI 0.45-0.61). RF models (MAE 0.37, SD 0.12) outperformed LSTM (MAE 0.87, SD 0.48) for predicting 1-6 month mRS difference, modeled as a non-binarized outcome. ConclusionsWe found that AI predicted short-term mRS and mRS changes after acute stroke symptoms from WWTA data with moderate performance. Future studies are warranted to investigate whether multimodal data can improve performance with the goal of developing objective, automatable functional status assessments.

Matching journals

The top 2 journals account for 50% of the predicted probability mass.

1
Journal of NeuroEngineering and Rehabilitation
28 papers in training set
Top 0.1%
27.0%
2
npj Digital Medicine
97 papers in training set
Top 0.1%
23.5%
50% of probability mass above
3
Frontiers in Neurology
91 papers in training set
Top 0.6%
8.6%
4
Scientific Reports
3102 papers in training set
Top 29%
4.1%
5
PLOS ONE
4510 papers in training set
Top 37%
3.7%
6
Journal of Neural Engineering
197 papers in training set
Top 0.8%
3.2%
7
Neurorehabilitation and Neural Repair
17 papers in training set
Top 0.2%
2.6%
8
Stroke
35 papers in training set
Top 0.5%
2.0%
9
Journal of Medical Internet Research
85 papers in training set
Top 2%
2.0%
10
Annals of Neurology
57 papers in training set
Top 1%
1.8%
11
Sensors
39 papers in training set
Top 1%
1.3%
12
NeuroImage: Clinical
132 papers in training set
Top 3%
1.0%
13
Journal of the American Heart Association
119 papers in training set
Top 3%
0.9%
14
Journal of the American Medical Informatics Association
61 papers in training set
Top 2%
0.8%
15
Advanced Science
249 papers in training set
Top 18%
0.8%
16
BioData Mining
15 papers in training set
Top 0.8%
0.8%
17
Communications Medicine
85 papers in training set
Top 0.9%
0.8%
18
PLOS Digital Health
91 papers in training set
Top 3%
0.7%
19
BMC Medical Informatics and Decision Making
39 papers in training set
Top 3%
0.7%
20
Neurology
44 papers in training set
Top 2%
0.7%
21
BMC Neurology
12 papers in training set
Top 1%
0.7%
22
BMC Medicine
163 papers in training set
Top 8%
0.7%
23
Brain Communications
147 papers in training set
Top 4%
0.5%