MR-based camera-less eye tracking using deep neural networks
Frey, M.; Nau, M.; Doeller, C. F.
Show abstract
Viewing behavior provides a window into many central aspects of human cognition and health, and it is an important variable of interest or confound in many fMRI studies. To make eye tracking freely and widely available for MRI research, we developed DeepMReye: a convolutional neural network that decodes gaze position from the MR-signal of the eyeballs. It performs camera-less eye tracking at sub-imaging temporal resolution in held-out participants with little training data and across a broad range of scanning protocols. Critically, it works even in existing datasets and when the eyes are closed. Decoded eye movements explain network-wide brain activity also in regions not associated with oculomotor function. This work emphasizes the importance of eye tracking for the interpretation of fMRI results and provides an open-source software solution that is widely applicable in research and clinical settings.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Ultra-low-field paediatric MRI in low- and middle-income countries: super-resolution using a multi-orientation U-Net 94%
- Assessing methods for geometric distortion compensation in 7T gradient echo fMRI data 94%
- FEMA: Fast and efficient mixed-effects algorithm for large sample whole-brain imaging data 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.