Feature harmonization reveals that apparent cross-cohort differences in tau-positivity prediction reflect variable availability and cohort stage structure
Bhat, A.; Cestari, M.; Chen, C.-T.; Fleming, B. T.; Fleming, G. T.; for the Alzheimer's Disease Neuroimaging Initiative,
Show abstract
Background: Cross-cohort machine-learning studies of tau positivity are increasingly used to assess generalizability of Alzheimer's disease biomarker models, but apparent differences between cohorts may reflect clinical severity structure and cohort stage composition rather than genuine biological divergence. Methods: We evaluated this problem across subject-level cohorts from the Alzheimer's Disease Neuroimaging Initiative (ADNI), the Open Access Series of Imaging Studies (OASIS3), and the National Alzheimer's Coordinating Center (NACC) using harmonized tabular predictors and a feature-block ablation framework. For ADNI and OASIS3, we performed matched-feature analyses restricted to shared harmonized variables (age, APOE e4, education, sex, the CDR(R) Dementia Staging Instrument sum-of-boxes score (CDR-SB), and the Functional Activities Questionnaire (FAQ)). Models were trained with five-fold stratified cross-validation using balanced logistic regression as the primary classifier. Random forests and extra-trees classifiers were evaluated as robustness checks and are reported in supplementary analyses. Results: In the primary matched-feature comparison, reference areas under the receiver operating characteristic curve (AUCs) were 0.851 for ADNI tau90, 0.860 for ADNI tau180, and 0.933 for OASIS3 tau180. Severity-only models retained 86-99% of reference performance, whereas demographic/genetic-only models retained 85-87%; bootstrap confidence intervals showed that the reference-minus-demo contrast remained positive across all primary cohorts. Before feature matching, OASIS3 showed substantially weaker demographic-only prediction (AUC approx. 0.54), attributable to missing APOE and age variables. After harmonization with a matched feature set including age, the pre-harmonization demographic gap was no longer attributable to feature availability; the residual difference was most consistent with cohort disease-stage composition asymmetry, with CDR-SB = 0 prevalence of 84.5-88.7% in OASIS3 versus 49.3-51.7% in ADNI. Conclusions: The original large ADNI-OASIS3 performance gap was largely a feature-availability artifact; after strict harmonization including age-field repair, the absolute gap narrowed and the signed ADNI-minus-OASIS3 difference reversed, with the residual difference most consistent with cohort disease-stage composition asymmetry. Clinical severity remains an important predictor across all cohorts, but the unique contributions of severity and demographic/genetic information depend strongly on stage composition. Cross-cohort biomarker modeling should account for both feature-set completeness and disease-stage composition heterogeneity, not only headline performance metrics.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Investigating the Amyloid-Tau-Neurodegeneration Framework in Alzheimer's Disease Using Semi-Supervised Multimodal Imaging Data Fusion 95%
- Evaluation of a speech-based AI system for early detection of Alzheimer’s disease remotely via smartphones 94%
- CenTauR: Towards a Universal Scale and Masks for Standardizing Tau Imaging Studies 94%
Similar papers in this journal
- Comparison and aggregation of event sequences across ten cohorts to describe the consensus biomarker evolution in Alzheimer’s disease 95%
- Early Syndecan-4 Upregulation Predicts Cognitive and Pathological Trajectories in Alzheimer Disease 95%
- Continuum of Core 1 Biomarkers in Preclinical Alzheimers Disease 95%
Similar papers in this journal
- A scoping review of remote and unsupervised digital cognitive assessments in preclinical Alzheimer’s disease 93%
- Machine Learning Prediction of Incidence of Alzheimers Disease Using Large-Scale Administrative Health Data 92%
- Interpretable deep learning approach for extracting cognitive features from hand-drawn images of intersecting pentagons in older adults 92%
Similar papers in this journal
- Predicting future cognitive impairment in preclinical Alzheimer's disease using multimodal imaging: a multisite machine learning study 95%
- Integrating plasma, MRI, and cognitive biomarkers for personalized prediction of decline across cognitive domains 95%
- Nucleus basalis of Meynert degeneration signals earliest stage of Alzheimer's disease progression 94%