Agentic Generative Artificial Intelligence System for Classification of Pathology-Confirmed Primary Progressive Aphasia Variants
Gallingani, C.; Miller, Z. A.; Mandelli, M. L.; Rosen, H. J.; Ezzes, Z.; Lin, M.; Rodriguez, D.; Seeley, W. W.; Miller, B.; Gorno-Tempini, M. L.; Pinheiro-Chagas, P.
Show abstract
ImportanceAccurate clinical and pathological diagnoses are essential in neurodegenerative diseases, especially given the emergence of pathology-specific disease-modifying therapies. However, diagnostic accuracy remains challenging due to heterogeneous clinical presentations, complexity of integrating multimodal data, and limited access to multidisciplinary expertise. Primary Progressive Aphasia (PPA) exemplifies these challenges, requiring specialized clinical, neuropsychological, and imaging evaluations. Generative artificial intelligence (AI), powered by large language models, may offer scalable diagnostic support in this context. ObjectiveTo evaluate the diagnostic performance of an agentic generative AI system in classifying prototypical PPA cases by clinical syndrome and underlying pathology. DesignRetrospective diagnostic validation study using a multi-agent generative AI architecture simulating expert-level reasoning. SettingSingle tertiary academic referral center (University of California San Francisco, Memory and Aging Center). ParticipantsFifty-four individuals with a definite diagnosis of PPA and post-mortem confirmation (18 semantic [svPPA], 17 logopenic [lvPPA], 19 nonfluent [nfvPPA]), selected as prototypical cases with congruent clinical, imaging, and pathological profiles. ExposureMultimodal input data, including clinical notes, neuropsychological and language assessments, and MRI brain images, were processed through a multi-agent architecture. The system generated diagnostic predictions under two conditions: (1) open-ended diagnosis from a set of 15 neurodegenerative clinical syndromes; (2) constrained classification of PPA variant and underlying neuropathology. Main Outcomes and MeasuresGenerative AI system diagnostic accuracy for clinical syndrome and pathology, based on expert clinical diagnoses and post-mortem confirmations as gold standard. ResultsIn the open-ended setting, the system correctly identified PPA in 49 of 54 cases (90.7%, chance level=6.7%). When constrained to PPA, it achieved 100% accuracy for svPPA and nfvPPA, and 94.1% for lvPPA as primary prediction. Neuropathological predictions were most accurate for FTLD-TDP type C (100%) and FTLD-4R tau (100%), and high for Alzheimers disease (94.4%). The full diagnostic pipeline of all 54 cases was completed in under 10 minutes. Conclusions and RelevanceThe AI system demonstrated expert-level performance in classifying prototypical PPA cases, integrating multimodal data and mirroring specialist reasoning. Its speed and accuracy support its potential role in extending access to specialized diagnostic expertise, particularly in non-tertiary settings. Further validation in larger and more heterogeneous populations is warranted.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Fox Insight Collects Online, Longitudinal Patient-Reported Outcomes and Genetic Data on Parkinson's Disease 91%
- Multi-Sequence Average Templates for Aging and Neurodegenerative Disease Populations 91%
- Lifespan reference curves for harmonizing multi-site regional brain white matter metrics from diffusion MRI 90%
Similar papers in this journal
- Interpretable deep learning approach for extracting cognitive features from hand-drawn images of intersecting pentagons in older adults 94%
- Crowdsourcing digital health measures to predict Parkinson's disease severity: the Parkinson's Disease Digital Biomarker DREAM Challenge 92%
- Conformal prediction enables disease course prediction and allows individualized diagnostic uncertainty in multiple sclerosis 92%