Evaluating the Potential of AI-Generated Synthetic Diaries in Parkinson's Disease Research
Hu, B.; Raza, F.; Wasif, S.; Patel, D.; Chomiak, T.
Show abstract
The integration of Artificial Intelligence (AI), particularly large language models like GPT-4o, into Parkinsons Disease (PD) research presents a novel approach for generating synthetic patient diaries. These technologies offer potential benefits, including addressing data privacy concerns, overcoming limited sample sizes, and accelerating research timelines by providing alternative data sources. By leveraging its internal knowledge, GPT-4o demonstrated the capability to replicate overall symptom prevalence distributions observed in a real PD patient dataset without significant statistical deviation. Despite these advantages, the widespread utility of AI-generated diaries based solely on internal knowledge is hindered by significant limitations identified in this case study. Key challenges include the failure to capture complex inter-variable correlations essential for understanding symptom co-occurrence, and a lack of the narrative richness, contextual depth, and linguistic nuance found in authentic patient reports. These findings underscore the constraints of current models in replicating real-world patient experiences without specific domain grounding. Addressing these challenges requires a multifaceted approach, including domain-specific fine-tuning, enhanced prompt engineering, and potentially hybrid data strategies to improve fidelity for high-stakes research applications. This case study explored the baseline capabilities and limitations of using GPT-4os internal knowledge for synthetic PD diary generation. It emphasizes the need for a balanced approach, acknowledging the potential for exploratory uses while highlighting the necessity for rigorous validation and further development before deployment in contexts requiring high fidelity. By fostering continued research and methodological refinement, AI-driven synthetic data generation can be better harnessed to support PD research and ultimately improve patient understanding.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Quantifying Device Type and Handedness Biases in a Remote Parkinson’s Disease AI-Powered Assessment 95%
- Crowdsourcing digital health measures to predict Parkinson's disease severity: the Parkinson's Disease Digital Biomarker DREAM Challenge 93%
- A Framework to Assess Clinical Safety and Hallucination Rates of LLMs for Medical Text Summarisation 92%
Similar papers in this journal
Similar papers in this journal
- Trajectories: a framework for detecting temporal clinical event sequences from health data standardized to the OMOP Common Data Model 92%
- Transforming Estonian health data to the Observational Medical Outcomes Partnership (OMOP) Common Data Model: lessons learned 91%
- Characterizing subgroup performance of probabilistic phenotype algorithms within older adults: A case study for dementia, mild cognitive impairment, and Alzheimer’s and Parkinson’s diseases 91%
Similar papers in this journal
- Exploring test retest reliability and longitudinal stability of digital biomarkers for Parkinson’s disease in the m-Power dataset 93%
- Structured Codes and Free-Text Notes: Measuring Information Complementarity in Electronic Health Records 93%
- COHD-COVID: Columbia Open Health Data for COVID-19 Research 92%
Similar papers in this journal
- Connecting real-world digital mobility assessment to clinical outcomes for regulatory and clinical endorsement – the Mobilise-D study protocol 93%
- Assessing and Predicting Efficacy of Dance Intervention for Parkinson's Disease 92%
- Development of the AD F ICE_IT clinical decision support system to assist deprescribing of fall-risk increasing drugs: A user-centered design approach 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.