Back

Natural Language Processing to Identify Patients with Cognitive Impairment

Hussein, K. I.; Chan, L.; Van Vleck, T.; Beers, K.; Mindt, M. R.; Wolf, M.; Curtis, L. M.; Agarwal, P.; Wisnivesky, J.; Nadkarni, G. N.; Federman, A.

2022-02-17 geriatric medicine
10.1101/2022.02.16.22271085 medRxiv
Show abstract

INTRODUCTIONEarly detection of patients with cognitive impairment may facilitate care for individuals in this population. Natural language processing (NLP) is a potential approach to identifying patients with cognitive impairment from electronic health records (EHR). METHODSWe used three machine learning algorithms (logistic regression, multilayer perceptron, and random forest) using clinical terms extracted by NLP to predict cognitive impairment in a cohort of 199 patients. Cognitive impairment was defined as a mini-mental status exams (MMSE) score <24. RESULTSNLP identified 69 (35%) patients with cognitive impairment and ICD codes identified 44 (22%). Using MMSE as a reference standard, NLP sensitivity was 35%, specificity 66%, precision 41%, and NPV 61%. The random forest method had the best test parameters; sensitivity 95%, specificity 100%, precision 100%, and NPV 97% DISCUSSIONNLP can identify adults with cognitive impairment with moderate test performance that is enhanced with machine learning.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

1
Biology Methods and Protocols
53 papers in training set
Top 0.1%
22.8%
2
Journal of Biomedical Informatics
45 papers in training set
Top 0.1%
10.6%
3
PLOS ONE
4510 papers in training set
Top 25%
6.9%
4
BMC Neurology
12 papers in training set
Top 0.1%
4.9%
5
BMC Medical Informatics and Decision Making
39 papers in training set
Top 0.6%
4.4%
6
Cureus
67 papers in training set
Top 1%
3.1%
50% of probability mass above
7
Journal of the American Medical Informatics Association
61 papers in training set
Top 0.8%
3.1%
8
Alzheimer's & Dementia
143 papers in training set
Top 1%
2.8%
9
Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring
38 papers in training set
Top 0.5%
2.6%
10
International Journal of Medical Informatics
25 papers in training set
Top 0.6%
2.5%
11
Journal of Alzheimer's Disease
43 papers in training set
Top 0.6%
2.4%
12
Scientific Reports
3102 papers in training set
Top 50%
2.1%
13
Journal of Medical Internet Research
85 papers in training set
Top 2%
2.1%
14
Computer Methods and Programs in Biomedicine
27 papers in training set
Top 0.2%
2.1%
15
PLOS Digital Health
91 papers in training set
Top 1%
2.1%
16
BMC Geriatrics
15 papers in training set
Top 0.2%
1.8%
17
BMC Bioinformatics
383 papers in training set
Top 5%
1.3%
18
Journal of the American Geriatrics Society
12 papers in training set
Top 0.2%
1.0%
19
BioData Mining
15 papers in training set
Top 0.6%
0.9%
20
BMC Medical Research Methodology
43 papers in training set
Top 1%
0.8%
21
BMJ Open
554 papers in training set
Top 12%
0.8%
22
Healthcare
16 papers in training set
Top 2%
0.8%
23
JMIR Medical Informatics
17 papers in training set
Top 1%
0.8%
24
JAMIA Open
37 papers in training set
Top 1%
0.8%
25
Frontiers in Physiology
93 papers in training set
Top 6%
0.8%
26
npj Digital Medicine
97 papers in training set
Top 3%
0.8%
27
Frontiers in Public Health
140 papers in training set
Top 8%
0.7%
28
Alzheimer's & Dementia: Translational Research & Clinical Interventions
16 papers in training set
Top 0.8%
0.7%
29
Frontiers in Medicine
113 papers in training set
Top 9%
0.5%
30
Artificial Intelligence in Medicine
15 papers in training set
Top 0.9%
0.5%