Back

Applications of Large Language Models (LLMs) in Breast Cancer Care

Sorin, V.; Glicksberg, B. S.; Barash, Y.; Konen, E.; Nadkarni, G.; Klang, E.

2023-11-04 health informatics
10.1101/2023.11.04.23298081 medRxiv
Show abstract

PurposeRecently introduced Large Language Models (LLMs) such as ChatGPT have already shown promising results in natural language processing in healthcare. The aim of this study is to systematically review the literature on the applications of LLMs in breast cancer diagnosis and care. MethodsA literature search was conducted using MEDLINE, focusing on studies published up to October 22nd, 2023, using the following terms: "large language models", "LLM", "GPT", "ChatGPT", "OpenAI", and "breast". ResultsFive studies met our inclusion criteria. All studies were published in 2023, focusing on ChatGPT-3.5 or GPT-4 by OpenAI. Applications included information extraction from clinical notes, question-answering based on guidelines, and patients management recommendations. The rate of correct answers varied from 64-98%, with the highest accuracy (88-98%) observed in information extraction and question-answering tasks. Notably, most studies utilized real patient data rather than data sourced from the internet. Limitations included inconsistent accuracy, prompt sensitivity, and overlooked clinical details, highlighting areas for cautious LLM integration into clinical practice. ConclusionLLMs demonstrate promise in text analysis tasks related to breast cancer care, including information extraction and guideline-based question-answering. However, variations in accuracy and the occurrence of erroneous outputs necessitate validation and oversight. Future works should focus on improving reliability of LLMs within clinical workflow.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

1
Artificial Intelligence in Medicine
15 papers in training set
Top 0.1%
12.2%
2
BMC Medical Informatics and Decision Making
39 papers in training set
Top 0.2%
9.9%
3
Journal of Medical Internet Research
85 papers in training set
Top 0.5%
8.0%
4
International Journal of Medical Informatics
25 papers in training set
Top 0.1%
7.0%
5
Journal of Biomedical Informatics
45 papers in training set
Top 0.2%
7.0%
6
Journal of the American Medical Informatics Association
61 papers in training set
Top 0.4%
6.7%
50% of probability mass above
7
Frontiers in Digital Health
20 papers in training set
Top 0.1%
6.2%
8
JMIR Medical Informatics
17 papers in training set
Top 0.3%
3.9%
9
JCO Clinical Cancer Informatics
18 papers in training set
Top 0.2%
3.8%
10
JAMIA Open
37 papers in training set
Top 0.5%
3.5%
11
Scientific Reports
3102 papers in training set
Top 43%
2.8%
12
BMC Medical Research Methodology
43 papers in training set
Top 0.3%
2.7%
13
Cancer Medicine
24 papers in training set
Top 0.6%
2.0%
14
npj Digital Medicine
97 papers in training set
Top 2%
2.0%
15
Frontiers in Artificial Intelligence
18 papers in training set
Top 0.2%
1.7%
16
BMJ Health & Care Informatics
13 papers in training set
Top 0.5%
1.7%
17
Computer Methods and Programs in Biomedicine
27 papers in training set
Top 0.5%
1.3%
18
PLOS Digital Health
91 papers in training set
Top 2%
1.3%
19
Biology Methods and Protocols
53 papers in training set
Top 1%
1.3%
20
BMC Bioinformatics
383 papers in training set
Top 6%
0.9%
21
IEEE Journal of Biomedical and Health Informatics
34 papers in training set
Top 2%
0.9%
22
Healthcare
16 papers in training set
Top 2%
0.8%
23
Cureus
67 papers in training set
Top 5%
0.7%
24
Journal of the American Heart Association
119 papers in training set
Top 4%
0.7%
25
PLOS ONE
4510 papers in training set
Top 70%
0.7%
26
Computers in Biology and Medicine
120 papers in training set
Top 5%
0.7%