Back

Detecting Primary Progressive Aphasia (PPA) from Text: A Benchmarking Study

Merhbene, G.; Lecron, F.; Fortemps, P.; Dickerson, B. C.; Kurpicz-Briki, M.; Rezaii, N.

2025-02-24 neuroscience
10.1101/2025.02.19.639032 bioRxiv
Show abstract

Classifying subtypes of primary progressive aphasia (PPA) from connected speech presents significant diagnostic challenges due to overlapping linguistic markers. This study benchmarks the performance of traditional machine learning models with various feature extraction techniques, transformer-based models, and large language models (LLMs) for PPA classification. Our results indicate that while transformerbased models and LLMs exceed chance-level performance in terms of balanced accuracy, traditional classifiers combined with contextual embeddings remain highly competitive. Notably, SVM using RoBERTas embeddings achieves the highest classification accuracy. These findings underscore the potential of machine learning in enhancing the automatic classification of PPA subtypes.

Matching journals

The top 11 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.