Back

Phenotyping Antidepressant Treatment Response with Deep Learning in Electronic Health Records

Sheu, Y.-h.; Magdamo, C.; Miller, M.; Das, S.; Blacker, D.; Smoller, J. W.

2021-08-04 psychiatry and clinical psychology
10.1101/2021.08.04.21261512 medRxiv
Show abstract

Efficient, accurate phenotyping for antidepressant treatment response in electronic health records (EHRs) could facilitate precision psychiatry applications but remains a challenge. Increasingly, artificial intelligence methods using "deep learning" applied to clinical data have shown promise in complex classification problems. Here, we systematically evaluate the performance of eight deep-learning-based natural language processing models in classifying response to antidepressants in a large real-world healthcare setting. We obtained data spanning 1990-2018 for adults with depression and a co-occurring antidepressant prescription from the EHR data warehouse of the Mass General Brigham healthcare system (n=111,572). Clinical notes were collected for the following time windows after antidepressant initiation: (1) 2 days to 4 weeks, (2) 4-12 weeks, and (3) 12-26 weeks. A stratified random sample of these note sets (total 4,299 across time periods) were manually reviewed to classify response status as "improved" or "no evidence of improvement" in depression symptoms. All models performed well, with areas under the receiver operator curve (AUROC) of at least 0.80. Positive predictive values (PPVs) ranged from 0.72 - 0.91. In general, models incorporating more information-dense and longer text sequences performed better than others. The best performing model (Longformer-large with sliding window) had an AUROC = 0.88 and PPV = 0.84 at a specificity of 0.88. Our results indicate that deep learning methods applied to EHR data can accurately classify antidepressant response in a real-world healthcare setting. Automated treatment response classification may facilitate a range of research and clinical decision support applications.

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

1
npj Digital Medicine
118 papers in training set
Top 0.1%
38.6%
2
Acta Psychiatrica Scandinavica
10 papers in training set
Top 0.1%
6.1%
3
JAMIA Open
42 papers in training set
Top 0.4%
4.7%
4
Frontiers in Digital Health
24 papers in training set
Top 0.4%
3.4%
50% of probability mass above
5
Journal of the American Medical Informatics Association
71 papers in training set
Top 1.0%
3.1%
6
BMC Medical Informatics and Decision Making
43 papers in training set
Top 0.7%
3.1%
7
Scientific Reports
3612 papers in training set
Top 37%
3.1%
8
Frontiers in Psychiatry
87 papers in training set
Top 0.8%
2.7%
9
Journal of Medical Internet Research
87 papers in training set
Top 1%
2.1%
10
Journal of Affective Disorders
92 papers in training set
Top 1%
1.9%
11
Acta Neuropsychiatrica
14 papers in training set
Top 0.2%
1.7%
12
JMIR Medical Informatics
18 papers in training set
Top 0.5%
1.6%
13
JAMA Psychiatry
15 papers in training set
Top 0.3%
1.3%
14
Schizophrenia
21 papers in training set
Top 0.3%
1.3%
15
JAMA Network Open
130 papers in training set
Top 3%
1.1%
16
PLOS ONE
5266 papers in training set
Top 56%
1.1%
17
Psychological Medicine
88 papers in training set
Top 2%
1.1%
18
Communications Medicine
113 papers in training set
Top 4%
1.1%
19
Scientific Data
209 papers in training set
Top 2%
1.1%
20
Computational Psychiatry
12 papers in training set
Top 0.1%
1.1%
21
Translational Psychiatry
260 papers in training set
Top 3%
1.0%
22
Psychiatry Research
41 papers in training set
Top 1%
1.0%
23
BioData Mining
22 papers in training set
Top 0.6%
1.0%
24
Nature Medicine
125 papers in training set
Top 4%
0.8%
25
International Journal of Medical Informatics
26 papers in training set
Top 1%
0.8%
26
Journal of Biomedical Informatics
47 papers in training set
Top 1%
0.8%
27
IEEE Journal of Biomedical and Health Informatics
37 papers in training set
Top 1%
0.8%
28
iScience
1154 papers in training set
Top 42%
0.6%
29
Frontiers in Artificial Intelligence
20 papers in training set
Top 1%
0.6%
30
PLOS Digital Health
106 papers in training set
Top 5%
0.6%