Back

Multimodal EEG-fNIRS Fusion for Passive BCI-based Depressive State Classification

Sakurai, R.; Kojima, S.; Otake-Matsuura, M.; Kanoh, S.; Rutkowski, T. M.

2026-04-08 neuroscience
10.64898/2026.04.07.716028 bioRxiv
Show abstract

Traditional psychiatric assessments for depression are often hindered by subjective bias and patient recall in-accuracy. This paper presents a multimodal passive Brain-Computer Interface (pBCI) designed for the objective screening of depressive traits through the end-to-end decoding of neural dynamics. We implemented a hybrid EEG-fNIRS framework to capture synchronized electro-hemodynamic responses during an emotional working memory (EWM) task. To classify sub-clinical depressive tendencies based on BDI-II scores, we utilized SincShallowNet, a deep learning architecture optimized for raw signal processing via learnable Sinc-filters. Our results demonstrate that the pBCI achieves peak performance in the auditory modality, with the integration of EEG and low-pass filtered fNIRS (0.15 Hz) yielding a balanced accuracy of 90.9% and an F1-score of 0.867. By isolating purely endogenous neural markers during the EWM maintenance phase, the system provides a robust "silent observer" for mental state monitoring. These findings validate the potential of multimodal pBCIs as high-precision, data-driven tools for early-stage depression screening, offering a scalable alternative to traditional clinical interviews and a foundation for longitudinal mental health monitoring.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

1
IEEE Journal of Biomedical and Health Informatics
34 papers in training set
Top 0.1%
19.3%
2
Journal of Neural Engineering
197 papers in training set
Top 0.2%
14.3%
3
Scientific Reports
3102 papers in training set
Top 19%
6.3%
4
Nature Communications
4913 papers in training set
Top 33%
4.8%
5
Frontiers in Psychiatry
83 papers in training set
Top 0.8%
4.3%
6
Advanced Science
249 papers in training set
Top 5%
3.9%
50% of probability mass above
7
NeuroImage
813 papers in training set
Top 2%
3.9%
8
Imaging Neuroscience
242 papers in training set
Top 0.9%
3.9%
9
Communications Biology
886 papers in training set
Top 1%
3.9%
10
Human Brain Mapping
295 papers in training set
Top 2%
2.1%
11
IEEE Transactions on Biomedical Engineering
38 papers in training set
Top 0.4%
1.9%
12
Frontiers in Neuroscience
223 papers in training set
Top 3%
1.9%
13
Nature Human Behaviour
85 papers in training set
Top 2%
1.9%
14
PLOS ONE
4510 papers in training set
Top 51%
1.9%
15
npj Digital Medicine
97 papers in training set
Top 2%
1.7%
16
Frontiers in Human Neuroscience
67 papers in training set
Top 1%
1.7%
17
Sensors
39 papers in training set
Top 1%
1.5%
18
Translational Psychiatry
219 papers in training set
Top 3%
1.2%
19
Science Advances
1098 papers in training set
Top 26%
0.9%
20
eBioMedicine
130 papers in training set
Top 3%
0.9%
21
Journal of Neuroscience Methods
106 papers in training set
Top 2%
0.7%
22
Proceedings of the National Academy of Sciences
2130 papers in training set
Top 44%
0.7%
23
iScience
1063 papers in training set
Top 35%
0.7%
24
IEEE Transactions on Neural Systems and Rehabilitation Engineering
40 papers in training set
Top 0.6%
0.7%