Improving Predictability, Test-Retest Reliability and Generalisability of Brain-Wide Associations for Cognitive Abilities via Multimodal Stacking

Brain-wide association studies (BWASs) have attempted to relate cognitive abilities with brain phenotypes, but have been challenged by issues such as predictability, test-retest reliability, and cross-cohort generalisability. To tackle these challenges, we proposed a machine-learning "stacking" approach that draws information from whole-brain magnetic resonance imaging (MRI) across different modalities, from task-fMRI contrasts and functional connectivity during tasks and rest to structural measures, into one prediction model. We benchmarked the benefits of stacking, using the Human Connectome Projects: Young Adults (n=873, 22-35 years old) and Human Connectome Projects-Aging (n=504, 35-100 years old) and the Dunedin Multidisciplinary Health and Development Study (Dunedin Study, n=754, 45 years old). For predictability, stacked models led to out-of-sample r[~].5-.6 when predicting cognitive abilities at the time of scanning, primarily driven by task-fMRI contrasts. Notably, using the Dunedin Study, we were able to predict participants cognitive abilities at ages 7, 9, and 11 using their multimodal MRI at age 45, with an out-of-sample r of 0.52. For test-retest reliability, stacked models reached an excellent level of reliability (ICC>.75), even when we stacked only task-fMRI contrasts together. For generalisability, a stacked model with non-task MRI built from one dataset significantly predicted cognitive abilities in other datasets. Altogether, stacking is a viable approach to undertake the three challenges of BWAS for cognitive abilities. Significance statementScientists have had limited success in predicting cognitive abilities from brain MRI. We proposed a machine learning method, called stacking, to draw information across different types of brain MRI. Using three large databases (n=2,131, 22-100 years old), we found stacking to make the prediction of cognitive abilities 1) closer to actual cognitive scores when applied to a new individual, not part of the modelling process, 2) reliable over times and 3) applicable to the data collected from different age groups and MRI scanners. Indeed, stacking, especially with fMRI task contrasts, allowed us to use MRI of people aged 45 to predict their childhood cognitive abilities reasonably well. Accordingly, stacking may help MRI realise its potential to predict cognitive abilities.