Back

Can GPT-4 suggest the optimal sequence for brain magnetic resonance imaging?

Suzuki, K.; Abe, K.; Sakai, S.

2024-08-02 radiology and imaging
10.1101/2024.07.31.24311123 medRxiv
Show abstract

PurposeThis study aimed to evaluate the potential of GPT-4, a large language model, in assisting radiologists to determine brain magnetic resonance imaging (MRI) protocols. MethodsWe used brain MRI protocols from a specific hospital, covering 20 diseases or examination purposes, excluding brain tumor protocols. GPT-4 was given system prompts to add one MRI sequence for the basic brain MRI protocol and disease names were input as user prompts. The models suggestions were evaluated by two radiologists with over 20 years of relevant experience. Suggestions were scored based on their alignment with the hospitals protocol as follows: 0 for inappropriate, 1 for acceptable but nonmatching, and 2 for matching the protocol. The experiment was conducted in both Japanese and English to compare GPT-4s performance in different languages. ResultsGPT-4 scored 27/40 points in English and 28/40 points in Japanese. GPT-4 gave inappropriate suggestions for Moyamoya disease and neuromyelitis optica in both languages and cerebral infarction in Japanese. For the other protocols, the suggested sequences were either appropriate or better. The suggestions in English differed from those in Japanese for seven protocols. ConclusionGPT-4 can suggest appropriate MRI sequences for each disease in addition to the standard brain MRI protocol. GPT-4s output is language-dependent and suggests brain MRI protocols tailored to specific regions and domains.

Matching journals

The top 3 journals account for 50% of the predicted probability mass.

1
European Radiology
14 papers in training set
Top 0.1%
37.8%
2
Scientific Reports
3102 papers in training set
Top 18%
6.4%
3
PLOS ONE
4510 papers in training set
Top 28%
6.3%
50% of probability mass above
4
Journal of Magnetic Resonance Imaging
14 papers in training set
Top 0.2%
3.6%
5
Frontiers in Neuroinformatics
38 papers in training set
Top 0.2%
3.1%
6
Computers in Biology and Medicine
120 papers in training set
Top 1%
2.4%
7
Frontiers in Neurology
91 papers in training set
Top 2%
2.1%
8
Neuroinformatics
40 papers in training set
Top 0.4%
1.9%
9
GigaScience
172 papers in training set
Top 1%
1.7%
10
NeuroImage
813 papers in training set
Top 4%
1.5%
11
Diagnostics
48 papers in training set
Top 1%
1.5%
12
Magnetic Resonance Imaging
21 papers in training set
Top 0.3%
1.5%
13
Frontiers in Medicine
113 papers in training set
Top 4%
1.3%
14
Informatics in Medicine Unlocked
21 papers in training set
Top 0.6%
1.3%
15
Aperture Neuro
18 papers in training set
Top 0.3%
0.9%
16
Neuro-Oncology Advances
24 papers in training set
Top 0.4%
0.9%
17
Frontiers in Psychology
49 papers in training set
Top 1.0%
0.9%
18
Annals of Translational Medicine
17 papers in training set
Top 1%
0.8%
19
Artificial Intelligence in Medicine
15 papers in training set
Top 0.6%
0.8%
20
Medical Physics
14 papers in training set
Top 0.6%
0.8%
21
Frontiers in Cardiovascular Medicine
49 papers in training set
Top 2%
0.8%
22
Medicine
30 papers in training set
Top 2%
0.7%
23
Archives of Clinical and Biomedical Research
28 papers in training set
Top 2%
0.7%
24
Frontiers in Neuroscience
223 papers in training set
Top 8%
0.7%
25
Journal of Medical Imaging
11 papers in training set
Top 0.4%
0.7%
26
JMIRx Med
31 papers in training set
Top 2%
0.6%
27
Frontiers in Oncology
95 papers in training set
Top 4%
0.6%
28
Bioengineering
24 papers in training set
Top 2%
0.6%
29
Physics in Medicine & Biology
17 papers in training set
Top 0.5%
0.6%
30
Data in Brief
13 papers in training set
Top 0.7%
0.6%