Back

Using Natural Language Processing as a Scalable Mental Status Evaluation Technique

Wagner, M.; Jagayat, J.; Kumar, A.; Shirazi, A.; Alavi, N.; Omrani, M.

2023-12-17 psychiatry and clinical psychology
10.1101/2023.12.15.23300047 medRxiv
Show abstract

Mental health is in a state of crisis with demand for mental health services significantly surpassing available care. As such, building scalable and objective measurement tools for mental health evaluation is of primary concern. Given the usage of spoken language in diagnostics and treatment, it stands out as potential methodology. Here a model is built for mental health status evaluation using natural language processing. Specifically, a RoBERTa-based model is fine-tuned on text from psychotherapy sessions to predict mental health status with prediction accuracy on par with clinical evaluations at 74%.

Matching journals

The top 4 journals account for 50% of the predicted probability mass.

1
Frontiers in Psychiatry
○ 83 papers in training set
Top 0.1%
32.9%
2
Acta Psychiatrica Scandinavica
○ 10 papers in training set
Top 0.1%
10.4%
3
Journal of Medical Internet Research
◐ 85 papers in training set
Top 0.8%
6.3%
4
Scientific Reports
○ 3102 papers in training set
Top 24%
4.8%
50% of probability mass above
5
Frontiers in Digital Health
○ 20 papers in training set
Top 0.1%
4.8%
6
BMC Medical Informatics and Decision Making
○ 39 papers in training set
Top 0.6%
4.8%
7
PLOS ONE
● 4510 papers in training set
Top 34%
4.3%
8
IEEE Access
● 31 papers in training set
Top 0.2%
2.4%
9
PLOS Digital Health
● 91 papers in training set
Top 1%
2.1%
10
IEEE Journal of Biomedical and Health Informatics
● 34 papers in training set
Top 0.8%
2.1%
11
npj Digital Medicine
○ 97 papers in training set
Top 2%
1.8%
12
Frontiers in Artificial Intelligence
○ 18 papers in training set
Top 0.2%
1.8%
13
PLOS Computational Biology
● 1633 papers in training set
Top 17%
1.7%
14
Translational Psychiatry
○ 219 papers in training set
Top 3%
1.3%
15
Nature Communications
○ 4913 papers in training set
Top 56%
1.2%
16
Bioengineering
○ 24 papers in training set
Top 0.7%
1.2%
17
Nature Medicine
○ 117 papers in training set
Top 4%
0.9%
18
Artificial Intelligence in Medicine
○ 15 papers in training set
Top 0.6%
0.8%
19
GigaScience
◐ 172 papers in training set
Top 3%
0.7%
20
Life
○ 27 papers in training set
Top 0.4%
0.7%
21
BioData Mining
○ 15 papers in training set
Top 1%
0.7%
22
Computational Psychiatry
● 12 papers in training set
Top 0.2%
0.7%
23
Psychiatry Research
○ 35 papers in training set
Top 2%
0.7%
24
Journal of the American Medical Informatics Association
◐ 61 papers in training set
Top 2%
0.7%
25
JMIR Formative Research
◐ 32 papers in training set
Top 2%
0.6%