Back

Evaluating the Readability and Reliability of Large Language Model Generated Information About Anxiety and Depression

2024-12-24 health informatics Title + abstract only
View on medRxiv
Show abstract

Artificial intelligence (AI) large language models (LLMs) hold great potential to transform psychiatry and mental health care by delivering relevant and tailored mental health information. This study aimed to evaluate the quality of mental health information generated by LLMs by determining their level of accessibility, reliability, and interpreting any bias present. Generative Pre-trained Transformer-4 (GPT-4) (San Francisco, California: Open AI), Gemini 1.5 Flash (Mountain View, California: Go...

Predicted journal destinations

1
Journal of the American Medical Informatics Association
53 training papers
Top 2% 11.5%
2
Journal of Medical Internet Research
81 training papers
Top 0.6% 10.7%
3
PLOS ONE
1737 training papers
Top 61% 9.1%
4
JMIR Formative Research
31 training papers
#1 7.6%
5
PLOS Digital Health
88 training papers
Top 4% 6.3%
6
JAMIA Open
35 training papers
Top 2% 6.3%
7
Frontiers in Psychiatry
56 training papers
Top 4% 4.1%
8
BMC Medical Informatics and Decision Making
36 training papers
Top 4% 4.1%
9
Journal of Biomedical Informatics
37 training papers
Top 4% 3.8%
10
BMJ Open
553 training papers
Top 40% 3.8%
11
International Journal of Medical Informatics
25 training papers
Top 2% 2.7%
12
Journal of Affective Disorders
72 training papers
Top 5% 2.7%
13
Frontiers in Digital Health
18 training papers
#1 2.1%
14
npj Digital Medicine
85 training papers
Top 10% 1.9%
15
Frontiers in Public Health
135 training papers
Top 16% 1.9%
16
Scientific Reports
701 training papers
Top 81% 1.9%
17
BMC Medical Research Methodology
41 training papers
Top 2% 1.8%
18
JMIR Medical Informatics
16 training papers
Top 4% 1.5%
19
JAMA Network Open
125 training papers
Top 17% 1.3%
20
International Journal of Environmental Research and Public Health
116 training papers
Top 23% 1.1%
21
JMIR Public Health and Surveillance
45 training papers
Top 6% 0.9%
22
Cureus
64 training papers
Top 17% 0.9%
23
Patterns
15 training papers
Top 4% 0.7%
24
JMIRx Med
29 training papers
Top 4% 0.7%
25
BMC Health Services Research
43 training papers
Top 6% 0.7%
26
BMJ Mental Health
15 training papers
Top 3% 0.7%
27
Psychiatry Research
33 training papers
Top 6% 0.7%