Time-Series Foundation Models for Cognitive Workload Classification using Eye-Tracking Data
Haag, J.; Gonzalez Nunez, J. G.; Kirkwood, B.; Legault, G.; Brattain, L.
Show abstract
Cognitive workload (CWL) assessment is relevant to a range of applications, such as monitoring driver fatigue and pilot attention, surgeon workload during complex procedures, and astronaut cognitive fatigue during long-duration missions. Eye-tracking datasets are generally small, which hinders the generalizability of the AI models. Time-series foundation models (TSFMs) have shown promise in mitigating this limitation as they are pretrained on large corpora and can be effectively fine-tuned with limited task-specific data. Although cognitive workload measurement has been explored in controlled settings, the ability of TSFMs to generalize to unseen individuals for CWL classification from eye-tracking data has not been studied. In this paper, two TSFMs, MOMENT and Moirai, were evaluated for CWL classification and compared against CNN, FFN, and LSTM baselines on two publicly available eye-tracking datasets. We used subject-level five-fold cross-validation in which data from each test subject were held out during training. We report accuracy, AUC, and F1-score with 95% confidence intervals. On the class-balanced EM-COGLOAD dataset, the pretrained TSFMs generalized markedly better to unseen subjects, with Moirai reaching 0.918 AUC and MOMENT 0.882 AUC, while the task-specific baselines remained near 0.70 AUC. On the class-imbalanced COLET dataset, even though the performance of all the models decreased, MOMENT was the most robust (0.670 AUC). Both TSFMs were also the most stable across held-out subjects, indicating that pretrained representations generalize more consistently across individuals than task-specific models in data-scarce eye-tracking settings.
Matching journals
The top 10 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Robust Disease Prognosis via Diagnostic Knowledge Preservation: A Sequential Learning Approach 91%
- Utilizing CNNs for classification and uncertainty quantification for 15 families of European fly pollinators 90%
- Small hand-designed convolutional neural networks outperform transfer learning in automated cell shape detection in confluent tissues 90%
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.