Back

A transformer model for predicting cognitive impairment from sleep

Song, T.-A.; Malekzadeh, M.; Saxena, R.; Purcell, S. M.; Dutta, J.

2022-07-18 neuroscience
10.1101/2022.07.17.500351 bioRxiv
Show abstract

Sleep disturbances are known to be aggravated with normal aging. Additionally, sleep disruptions have a potentially bidirectional causal relationship with dementia due to neurodegenerative diseases like Alzheimers disease. Predictive techniques that can automatically detect cognitive impairment from an individuals sleep data have broad clinical and biological significance. Here, we present a deep learning approach based on a transformer architecture to predict cognitive status from sleep electroencephalography (EEG) data. This work uses data from N = 1, 502 subjects from the Multi-Ethnic Study of Atherosclerosis (MESA) cohort. Our transformer model achieves 70.22% accuracy at the binary classification task for distinguishing cognitively normal and impaired subjects based on their sleep EEG. Our method outperforms traditional feature handcrafting, which has an overall accuracy of 57.61% for the same task. We use a sparse regression model to understand and interpret the information captured by each learned feature from our transformer model. To our knowledge, this is the first effort to use deep learning to predict cognitive impairment from sleep metrics.

Matching journals

The top 8 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.