Domain-adapted language model using reinforcement learning for various dementias
Kowshik, S. S.; Jasodanand, V. H.; Bellitti, M.; Puducheri, S.; Xu, L.; Liu, Y.; Saichandran, K. S.; Dwyer, B. C.; Gabelle, A.; Hao, H.; Kedar, S.; Murman, D. L.; O'Shea, S.; Saint-Hilaire, M.-H.; Samudra, N. P.; Sartor, E. A.; Swaminathan, A.; Taraschenko, O.; Yuan, J.; Au, R.; Kolachalama, V. B.
Show abstract
Large language models excel at processing complex clinical data and advanced reasoning, yet domain-specific adaptation is essential to realize their full potential in fields such as Alzheimers disease and related dementias (ADRD). Here, we present a generative language model for ADRD fine-tuned via reinforcement learning with verifiable rewards using a self-certainty-aware advantage. Model development and validation leveraged data from five ADRD cohorts, totaling 54, 535 participants. Our framework integrates demographics, personal and family medical histories, medication use, neuropsychological test results, functional assessments, physical and neurological examination findings, laboratory data and multimodal neuroimaging to construct comprehensive clinical profiles. On held-out testing data involving 36, 688 participants, our model achieved robust performance on syndromic classification, primary etiological diagnosis and biomarker prediction. Model predictions were validated against postmortem-confirmed diagnoses, and clinical utility was demonstrated in a controlled within-subjects crossover study where board-certified neurologists reviewed cases with and with-out model assistance, showing that exposure to model responses improved diagnostic performance. These results demonstrate that targeted domain adaptation with reinforcement learning can enable language models to deliver accurate, reasoning-driven support in ADRD evaluation. Prospective validation will be essential to translate these advances into improved patient outcomes.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Interpretable deep learning approach for extracting cognitive features from hand-drawn images of intersecting pentagons in older adults 93%
- Biologically-informed deep neural networks provide quantitative assessment of intratumoral heterogeneity in post-treatment glioblastoma 93%
- Understanding the robustness of vision-language models to medical image artefacts 93%
Similar papers in this journal
- AI-driven fusion of neurological work-up for assessment of biological Alzheimer’s disease 97%
- Molecular estimation of neurodegeneration pseudotime in older brains 94%
- Cell-type-specific Alzheimer’s disease polygenic risk scores are associated with distinct disease processes in Alzheimer’s disease 93%
Similar papers in this journal
Similar papers in this journal
- A modeling framework for adaptive lifelong learning with transfer and savings through gating in the prefrontal cortex 92%
- Predicting clinical drug response from model systems by non-linear subspace-based transfer learning 91%
- An interpretable molecular framework for predicting cancer driver missense mutations 91%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.