Back

VOGeo-Gaze: Calibration-Free, Geometry-Aware Deep Learning for Real-Time Gaze Tracking in Clinical Video-Oculography

Zhao, J.; Ahmadi, S.-A.; Decker, J.; Zwergal, A.; Eulenburg, P. z.; Flanagin, V. L.; Wuehr, M.

2026-05-29 health informatics
10.64898/2026.05.27.26354254 medRxiv
Show abstract

Quantitative eye movement analysis is important for neuro- logical diagnostics, yet existing video-oculography (VOG) systems typ- ically require calibration, device-specific settings, or accurate gaze la- bels. We present VOGeo-Gaze, a real-time, calibration-free, geometry- aware neural network that estimates gaze by reconstructing anatomi- cally meaningful eyeball parameters from image features. The method combines segmentation-driven projection geometry, a refraction-aware pupil correction module, and temporal anatomical stabilization, so gaze is derived from interpretable eye geometry rather than direct angular regression. Trained only on the public TEyeD dataset with weak gaze supervision, VOGeo-Gaze was evaluated on 116 clinical recordings from 17 patients and 19 healthy subjects using EyeSeeCam, a clinical gold- standard VOG system. It achieved median absolute angular errors of 0.33{whitebullet} horizontally and 0.35{whitebullet} vertically, with nearly 92% of recordings below 1{whitebullet} error while operating at >300 FPS. These results demonstrate sub-degree clinical gaze estimation without subject-specific calibration, camera intrinsics, or accurate gaze labels, providing a scalable and inter- pretable alternative to conventional VOG pipelines. Code is available at https://github.com/DSGZ-MotionLab/VOGeo-Gaze.

Matching journals

The top 7 journals account for 50% of the predicted probability mass.

1
Scientific Reports
3102 papers in training set
Top 2%
14.9%
2
Nature Communications
4913 papers in training set
Top 16%
10.6%
3
Scientific Data
174 papers in training set
Top 0.2%
8.5%
4
IEEE Transactions on Biomedical Engineering
38 papers in training set
Top 0.1%
6.4%
5
npj Digital Medicine
97 papers in training set
Top 1%
4.4%
6
Frontiers in Neurology
91 papers in training set
Top 2%
3.6%
7
PLOS ONE
4510 papers in training set
Top 38%
3.6%
50% of probability mass above
8
Neurophotonics
37 papers in training set
Top 0.2%
2.6%
9
Science Advances
1098 papers in training set
Top 11%
2.4%
10
Communications Biology
886 papers in training set
Top 5%
2.1%
11
NeuroImage
813 papers in training set
Top 4%
1.9%
12
IEEE Journal of Biomedical and Health Informatics
34 papers in training set
Top 0.8%
1.9%
13
Journal of Vision
92 papers in training set
Top 0.2%
1.9%
14
Science Translational Medicine
111 papers in training set
Top 2%
1.8%
15
Nature Biomedical Engineering
42 papers in training set
Top 0.8%
1.7%
16
PLOS Digital Health
91 papers in training set
Top 1%
1.7%
17
Human Brain Mapping
295 papers in training set
Top 3%
1.7%
18
NeuroImage: Clinical
132 papers in training set
Top 3%
1.5%
19
Frontiers in Medicine
113 papers in training set
Top 4%
1.5%
20
Nature Machine Intelligence
61 papers in training set
Top 2%
1.3%
21
Journal of Neural Engineering
197 papers in training set
Top 1%
1.3%
22
eBioMedicine
130 papers in training set
Top 3%
1.0%
23
Frontiers in Aging Neuroscience
67 papers in training set
Top 3%
0.8%
24
Bioinformatics
1061 papers in training set
Top 9%
0.8%
25
Advanced Science
249 papers in training set
Top 19%
0.8%
26
Journal of Medical Internet Research
85 papers in training set
Top 5%
0.7%
27
Ophthalmology Science
20 papers in training set
Top 0.3%
0.7%
28
Biomedical Optics Express
84 papers in training set
Top 1%
0.7%
29
iScience
1063 papers in training set
Top 36%
0.7%
30
Nature Medicine
117 papers in training set
Top 6%
0.7%