Back

Developing better digital health measures of Parkinson's disease using free living data and a crowdsourced data analysis challenge

Sieberts, S.; Borzymowski, H.; Guan, Y.; Huang, Y.; Matzner, A.; Page, A.; Bar-Gad, I.; Beaulieu-Jones, B.; El-Hanani, Y.; Goschenhofer, J.; Javidnia, M.; Keller, M. S.; Li, Y.-c.; Venuto, C.; Saqib, M.; Smith, G.; Stanescu, A.; Zielinski, R.; the BEAT-PD DREAM Challenge Consortium, ; Jayaraman, A.; Evers, L. J. W.; Foschini, L.; Mariakakis, A.; Pandey, G.; Shawen, N.; Snyder, P.; Omberg, L.

2021-10-23 neurology
10.1101/2021.10.20.21265298 medRxiv
Show abstract

One of the promising opportunities of digital health is its potential to lead to more holistic understandings of diseases by interacting with the daily life of patients and through the collection of large amounts of real world data. Validating and benchmarking indicators of disease severity in the home setting is difficult, however, given the large number of confounders present in the real world and the challenges in collecting ground truth data in the home. Here we leverage two datasets with continuous wrist-worn accelerometer data coupled with frequent symptom reports in the home setting, to develop digital biomarkers of symptom severity. Using these data, we performed a public benchmarking challenge in which participants were asked to build measures of severity across 3 symptoms (on/off medication, dyskinesia, and tremor). 42 teams participated and performance was improved over baseline models for each subchallenge. Additional ensemble modeling across submissions further improved performance, and the top models validated in a subset of patients whose symptoms were observed and rated by trained clinicians.

Matching journals

The top 2 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.