HealthFound: a health world model for quantitative reasoning on longitudinal health profiles
Guo, H.; Song, L.; Ren, P.; Han, J.; Wang, Y.; Li, H.; Deng, J.; Wang, J.; Gong, W.; Feng, J.; Cheng, W.
Show abstract
Medical large language models (LLMs) have shown promise in medical knowledge retrieval and clinical reasoning. However, their capacity for quantitative reasoning over dense, longitudinal health data remains limited, largely due to the lack of effective training strategies that leverage large-scale, natural-language-based prospective cohorts. To address this, we present HealthFound, a medical LLM trained on 12.4 million self-constructed examples. These include 15-year longitudinal biomedical records from 501,936 participants, as well as datasets for medical knowledge and general reasoning. We propose a novel three-stage training framework comprising progressive curriculum supervised fine-tuning, rejection-sampled retention fine-tuning, and task-verifiable policy optimization. This enables the model to effectively parse heterogeneous quantitative follow-up data and perform robust quantitative reasoning. HealthFound achieves state-of-the-art performance across multiple newly constructed benchmarks. It attains the highest accuracy on eight public medical benchmarks for general medical competence. On 1,162 UK Biobank tasks predicting future disease onset from biomedical measurements, it outperforms the second-best model by over 10 percentage points on average. In two independent external validations (MIMIC-IV and NHANES), it demonstrates superior zero-shot generalization, achieving improvements of over 6% across 484 disease endpoints. The model also achieves top results on novel tasks for literature-derived question answering and quantitative indicator imputation. Furthermore, HealthFound generates interpretable reasoning rationales that are consistent with established biomedical knowledge. Collectively, our results demonstrate that HealthFound enables medical LLMs to evolve from static knowledge repositories into dynamic quantitative reasoning engines over longitudinal health data.
Matching journals
The top 1 journal accounts for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Large language models improve transferability of electronic health record-based predictions across countries and coding systems 97%
- Interpretable Fine-tuned Large Language Models Facilitate Making Genetic Test Decisions for Rare Diseases 95%
- High-Sensitivity Pan-Cancer AI Assessment of Lymph Node Metastasis via Uncertainty Quantification 94%
Similar papers in this journal
Similar papers in this journal
- Leveraging sequences missing from the human genome to diagnose cancer 92%
- Pretrained Patient Trajectories for Adverse Drug Event Prediction Using Common Data Model-based Electronic Health Records 92%
- Achieving Inclusive Healthcare through Integrating Education and Research with AI and Personalized Curricula 90%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.