Episode-Driven Insights: Can Large Language Models Tackle Multimodal Diabetes Data?
Choi, H. J.; Raj, S.
Show abstract
This study explores the potential of state-of-the-art large language models (LLM) to scaffold type 1 diabetes management by automating the analysis of multimodal diabetes device data, including blood glucose, carbohydrate, and insulin. By conducting a series of empirically grounded data analysis tasks, such as detecting glycemic episodes, clustering similar episodes into patterns, identifying counterfactual days, and performing visual data analysis, we assess whether models like ChatGPT 4o, Claude 3.5 Sonnet, and Gemini Advanced can offer meaningful insights from diabetes data. Our findings show that ChatGPT 4o demonstrates strong potential in accurately interpreting data in the context of specific glycemic episodes, identifying glycemic patterns, and analyzing patterns. However, limitations in handling edge cases and visual reasoning tasks highlight areas for future development. Using LLMs to automate data analysis tasks and generate narrative summaries could scaffold clinical decision-making in diabetes management, which could make frequent data review feasible for improved patient outcomes.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Evaluating large language model workflows in clinical decision support: referral, triage, and diagnosis 93%
- Development and Prospective Implementation of a Large Language Model based System for Early Sepsis Prediction 93%
- Dataset Documentation for Responsible AI: Analysis of Suitability and Usage for Health Datasets 92%
Similar papers in this journal
- MMFP-Tableau: Enabling Precision Mitochondrial Medicine through Integration, Visualization, and Analytics of Clinical and Research Health System Electronic Data 93%
- A Simple Electronic Medical Record System Designed for Research 93%
- Trajectories: a framework for detecting temporal clinical event sequences from health data standardized to the OMOP Common Data Model 92%
Similar papers in this journal
- Racial disparities in continuous glucose monitoring-based 60-min glucose predictions among people with type 1 diabetes 93%
- A data management system for precision medicine 92%
- From months to minutes: creating Hyperion, a novel data management system expediting data insights for oncology research and patient care 91%
Similar papers in this journal
- Transformative potential of Large Language Models in data mining on Electronic Health Records. 92%
- Assessment of Accuracy and Safety of LabTest Checker (LTC-AI) 91%
- Evaluating the impact on clinical task efficiency of a natural language processing algorithm for searching medical documents: Prospective crossover study 91%
Similar papers in this journal
- Large Language Models Facilitate the Generation of Electronic Health Record Phenotyping Algorithms 93%
- Empowering Personalized Pharmacogenomics with Generative AI Solutions 93%
- Usability of a Machine-Learning Clinical Order Recommender System Interface for Clinical Decision Support and Physician Workflow 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.