Back

Developing a GraphRAG-enabled local-LLM for Gestational Diabetes Mellitus.

Sharma, R.

2025-04-30 endocrinology
10.1101/2025.04.28.25326568 medRxiv
Show abstract

This paper re-imagines a world of abundance in the treatment of chronic diseases such as Tpe 2 Diabetes. It asks: what if preventive and diagnostic remedies were widely made available across the world, informed by the latest medical research? As Proof-of-Concept of a proposed solution, the paper describes the development and validation of a local Large Language Models (local-LLMs) based on Graph-based Retrieval-Augmented Generation (GraphRAG) for managing Gestational Diabetes Mellitus (GDM). The research thus seeks new insights into optimizing GDM treatment through a knowledge graph architecture, contributing to a deeper understanding of how artificial intelligence can extend medical expertise to underserved populations globally. The study employs an agile, prototyping approach utilizing GraphRAG to enhance knowledge graphs by integrating retrieval-based and generative artificial intelligence techniques. Training data was from academic papers published between January 2000 and May 2024 using the Semantic Scholar API and analyzed by mapping complex associations within GDM management to create a comprehensive knowledge graph architecture. It is categorically stated that, since the primary research objective was to establish the feasibility of a GraphRAG local-LLM PoC, no human subjects nor actual patient datasets were used. Empirical results indicate that the GraphRAG-based Proof of Concept outperforms open-source LLMs such as ChatGPT, Claude, and BioMistral across key evaluation metrics. Specifically, GraphRAG achieves superior accuracy with BLEU scores of 0.99, Jaccard similarity of 0.98, and BERT scores of 0.98, offering significant implications for personalized medical insights that enhance diagnostic accuracy and treatment efficacy. This research offers a novel perspective on applying GraphRAG-enabled LLM technologies to GDM management, providing valuable insights that extend current understanding of AI applications in healthcare. The studys findings contribute to advancing the feasibility of GenAI for proactive GDM treatment and extending medical expertise to underserved populations globally.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

1
Bioengineering
24 papers in training set
Top 0.1%
22.6%
2
Expert Systems with Applications
11 papers in training set
Top 0.1%
14.4%
3
PLOS Digital Health
91 papers in training set
Top 0.4%
6.4%
4
PLOS ONE
4510 papers in training set
Top 31%
4.9%
5
iScience
1063 papers in training set
Top 3%
4.4%
50% of probability mass above
6
Scientific Reports
3102 papers in training set
Top 27%
4.3%
7
Advanced Science
249 papers in training set
Top 4%
4.3%
8
Heliyon
146 papers in training set
Top 0.6%
2.7%
9
Computational and Structural Biotechnology Journal
216 papers in training set
Top 3%
2.1%
10
JMIR Medical Informatics
17 papers in training set
Top 0.5%
2.1%
11
Journal of the American Medical Informatics Association
61 papers in training set
Top 1%
1.9%
12
npj Digital Medicine
97 papers in training set
Top 2%
1.9%
13
Frontiers in Physiology
93 papers in training set
Top 3%
1.7%
14
Bioinformatics Advances
184 papers in training set
Top 3%
1.7%
15
Computers in Biology and Medicine
120 papers in training set
Top 2%
1.7%
16
GigaScience
172 papers in training set
Top 1%
1.7%
17
Journal of Pathology Informatics
13 papers in training set
Top 0.2%
1.5%
18
Biology
43 papers in training set
Top 1%
1.1%
19
BMC Medical Informatics and Decision Making
39 papers in training set
Top 2%
1.0%
20
Journal of Biomedical Informatics
45 papers in training set
Top 1%
0.9%
21
Biology Methods and Protocols
53 papers in training set
Top 2%
0.9%
22
Journal of Medical Internet Research
85 papers in training set
Top 4%
0.9%
23
Cureus
67 papers in training set
Top 4%
0.8%
24
International Journal of Medical Informatics
25 papers in training set
Top 1%
0.8%
25
Computer Methods and Programs in Biomedicine
27 papers in training set
Top 1.0%
0.7%
26
PeerJ
261 papers in training set
Top 15%
0.7%
27
Data in Brief
13 papers in training set
Top 0.5%
0.7%
28
BMC Bioinformatics
383 papers in training set
Top 7%
0.7%
29
BMC Medical Education
20 papers in training set
Top 0.9%
0.7%
30
Biomedicines
66 papers in training set
Top 4%
0.6%