Cross-modal quality transfer: enhancing MEG spatial resolution using BOLD-fMRI and Explainable machine learning.
Benacek, J.; Singh, K. D.; Jones, D. K.; Asquith, P.; Marshall, D.; Rushton, S.; Palombo, M.
Show abstract
Purpose:1Blood-oxygen-level-dependent functional MRI (BOLD-fMRI) and magnetoencephalog-raphy (MEG) offer complementary insights into brain function, with BOLD-fMRI providing high spatial resolution and MEG offering high temporal sensitivity. This study aimed to enhance MEGs spatial resolution through learning inter-modal relationships via data-driven fusion with BOLD-fMRI using explainable machine learning (xML). MethodsMEG and BOLD-fMRI data were collected for sixteen participants watching the same naturalistic visual stimulus. MEG signals were filtered into standard frequency bands and processed to match the haemodynamic response. Data were then decomposed using Tenso-rial Independent Component Analysis (TICA), yielding 250 MEG (25 per frequency band) and 30 BOLD-fMRI components. A set of Extreme Gradient Boosted tree (XGBoost) models were trained to predict MEG component activity from downsampled BOLD-fMRI components. The models with best-performing configuration of hyperparameters at this resolution were then used to generate voxelwise upsampled MEG maps using the natively higher-resolution BOLD-fMRI data. Performance was compared to trilinear interpolation using R{superscript 2}, mean squared error (MSE), and structural similarity index (SSI). Model inter-pretability was enhanced by generating Shapley values (SHAP), describing relationships between input data and model output. ResultsModels trained on 6mm3 data achieved high predictive performance on previously unseen data (R{superscript 2} = 0.80, MSE = .07). Using higher-resolution 2mm3 BOLD-fMRI data, MEG activ-ity was upsampled to 2mm3, resulting in more detailed image, while maintaining reasonable congruence to naive interpolation (R{superscript 2} = .81, MSE = .06). ConclusionsThis work demonstrates that explainable machine learning enables spatial super-resolution of MEG maps via BOLD-fMRI-informed quality transfer, enabling enhancement of spatial resolution, and offering improved localization, as well as means of generating data-driven insights into neurovascular coupling.
Matching journals
The top 2 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- Sub-millimetre resolution laminar fMRI using Arterial Spin Labelling in humans at 7T 95%
- Personalized models of Disorders of Consciousness revealcomplementary roles of connectivity and local parameters in diagnosis and prognosis 95%
- Dynamic up- and down-regulation of the default (DMN) and extrinsic (EMN) mode networks during alternating task-on and task-off periods 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.