Assessing spoken discourse in aphasia using multimodal artificial intelligence
Marte, M. J.; Lee, S. H.; Wang, S.; Goldin, K.; Varkanitsa, M.; Girard, J. M.; Brito, R.; Wei, X.; Baker, J. T.; Tie, Y.; Kiran, S.; Liebenthal, E.
Show abstract
Discourse analysis can reliably predict real-world communicative success, yet is rarely implemented clinically, due to challenges in manually generating stimulus-specific main concept inventories (MCIs) and scoring patient narratives. We evaluated whether automatically derived macrolinguistic (main concept, sentiment) and microlinguistic (fluency, lexical, syntactic) features extracted from movie clip narrations can augment the clinical assessment of discourse in aphasia. The MCIs generated directly from each clip's video, audio and subtitles using a vision-language model approximated the main concepts healthy controls produced. Group classification (control: n=51; aphasia: n=54) based on the discourse features was excellent (AUC=0.95, 95% CI [0.90, 0.99]), with macrolinguistic features showing the largest group differences (main concept completeness: d=-1.84, 95% CI [-2.30, -1.38]) and strongest associations with aphasia severity (semantic distance to inventory: r=-0.79, 95% CI [-0.87, -0.66]). Findings support the feasibility and scalability of automated criterion-based discourse assessment using ecological stimuli, and highlight its potential for clinical implementation.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- The Progressive Aphasia Communication Toolkit (PACT): A Strengths-Based Approach to Multidomain Evaluation for Intervention 95%
- Reliability of remote self-administered web-based digital cognitive measures and comparison to in-person neuropsychological tests: Stricker Learning Span, Symbols Test and the Mayo Test Drive Screening Battery Composite 89%
- Memorability of photographs in subjective cognitive decline and mild cognitive impairment: implications for cognitive assessment 88%
Similar papers in this journal
- Dementia is our "biggest expanding caseload": Core learning for student speech and language therapists 91%
- tbiExtractor: A framework for Extracting Traumatic Brain Injury Common Data Elements from Radiology Reports 90%
- Hearing and cognitive decline in aging differentially impact neural tracking of context-supported versus random speech across linguistic timescales 90%
Similar papers in this journal
- Lesion site and therapy time predict responses to a therapy for anomia after stroke: a prognostic model development study 91%
- Auditory beat perception is related to speech output fluency in post-stroke aphasia 91%
- Can you affect me? The influence of vitality forms on action perception and motor response 90%
Similar papers in this journal
- Baseline functional connectivity predicts who will benefit from neuromodulation: evidence from primary progressive aphasia 90%
- Predictors of arm non-use in chronic stroke: a preliminary investigation 87%
- Beyond the Wrist: Finger-Worn Accelerometers Enhance Assessment of Post-Stroke Motor Performance 87%
Similar papers in this journal
- Sensitive quantification of cerebellar speech abnormalities using deep learning models 89%
- Limited diagnostic accuracy of smartphone-based digital biomarkers for Parkinson’s disease in a remotely-administered setting 86%
- The Role of the Eyes: Investigating Face Cognition Mechanisms Using Machine Learning and Partial Face Stimuli 86%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.