Back

HybridNet-XR: Efficient Teacher-Free Self-Supervised Learning for Autonomous Medical Diagnostic Systems in Resource-Constrained Environments.

Mayala, S.; Mzurikwao, D.; Suluba, E.

2026-03-19 health informatics
10.64898/2026.03.16.26348570 medRxiv
Show abstract

Deep learning model classification on large datasets is often limited in countries with restricted computational resources. While transfer learning can offset these limitations, standard architectures often maintain a high memory footprint. This study introduces HybridNet-XR, a memory-efficient and computationally lightweight hybrid convolutional neural network (CNN) designed to bridge the domain gap in medical radiography using autonomous self-supervised learning protocols. The HybridNet-XR architecture integrates depthwise separable convolutions for parameter reduction, residual connections for gradient stability, and aggressive early downsampling to minimize the video RAM (VRAM) footprint. We evaluated several training paradigms, including teacher-free self-supervised learning (SSL-SimCLR), teacher-led knowledge distillation (KD), and domain-gap (DG) adaptation. Each variant was pre-trained on ImageNet-1k subsets and fine-tuned on the ChestX6 multi-class dataset. Model interpretability was validated through gradient-weighted class activation mapping (Grad-CAM). The performance frontier analysis identified the HybridNet-XR-150-PW (Pre-warmed) as the optimal configuration, achieving a 93.38% average accuracy and 99% AUC while utilizing only 814.80 MB of VRAM. Regarding class-wise accuracy, this variant significantly outperformed standard MobileNetV2 and teacher-led models in critical diagnostic categories, notably Covid-19 (97.98%) and Emphysema (96.80%). Grad-CAM visualizations confirmed that the teacher-free pre-warming phase allows the model to develop sharper, anatomically grounded focus on pathological landmarks compared to distilled models. Specialized pre-warming schedules offer a viable, computationally autonomous alternative to knowledge distillation for medical imaging. By eliminating the requirement for high-performance teacher models, HybridNet-XR provides a robust and trustworthy diagnostic foundation suitable for clinical deployment in resource-constrained environments. Author summaryTraditional deep learning models for medical imaging are often too large for the low-power computers available in many global health settings. We developed a new model to bridge this computational gap. We designed HybridNet-XR, a highly efficient AI architecture, and trained it using a "teacher-free" method that doesnt require a massive supercomputer. We found a specific version (H-XR150-PW) that provides high accuracy while using very little memory. Our results show that high-performance diagnostic AI can be deployed on standard, low-cost hardware. Furthermore, using visual heatmaps (Grad-CAM), we proved that the AI correctly identifies medical landmarks like lung opacities, ensuring it is safe and reliable for real-world clinical use.

Matching journals

The top 10 journals account for 50% of the predicted probability mass.

1
PLOS Digital Health
91 papers in training set
Top 0.2%
10.0%
2
Medical Image Analysis
33 papers in training set
Top 0.1%
8.4%
3
Scientific Reports
3102 papers in training set
Top 24%
4.8%
4
npj Digital Medicine
97 papers in training set
Top 1.0%
4.3%
5
BMC Medical Informatics and Decision Making
39 papers in training set
Top 0.6%
4.3%
6
PLOS ONE
4510 papers in training set
Top 34%
4.3%
7
Computer Methods and Programs in Biomedicine
27 papers in training set
Top 0.1%
3.9%
8
Computers in Biology and Medicine
120 papers in training set
Top 0.9%
3.6%
9
Frontiers in Neuroinformatics
38 papers in training set
Top 0.2%
3.6%
10
Patterns
70 papers in training set
Top 0.2%
3.6%
50% of probability mass above
11
Biology Methods and Protocols
53 papers in training set
Top 0.3%
3.6%
12
IEEE Transactions on Biomedical Engineering
38 papers in training set
Top 0.3%
2.6%
13
Nature Machine Intelligence
61 papers in training set
Top 1%
2.1%
14
Bioinformatics
1061 papers in training set
Top 7%
2.1%
15
Frontiers in Artificial Intelligence
18 papers in training set
Top 0.2%
1.9%
16
NeuroImage
813 papers in training set
Top 4%
1.7%
17
Nature Communications
4913 papers in training set
Top 52%
1.7%
18
PLOS Computational Biology
1633 papers in training set
Top 18%
1.5%
19
Diagnostics
48 papers in training set
Top 1%
1.3%
20
Expert Systems with Applications
11 papers in training set
Top 0.2%
1.3%
21
Medical Physics
14 papers in training set
Top 0.4%
1.3%
22
IEEE Journal of Biomedical and Health Informatics
34 papers in training set
Top 1%
1.2%
23
Journal of Medical Imaging
11 papers in training set
Top 0.2%
1.1%
24
Artificial Intelligence in Medicine
15 papers in training set
Top 0.5%
0.9%
25
Frontiers in Physiology
93 papers in training set
Top 4%
0.9%
26
Human Brain Mapping
295 papers in training set
Top 4%
0.9%
27
Frontiers in Bioinformatics
45 papers in training set
Top 0.7%
0.9%
28
Frontiers in Medicine
113 papers in training set
Top 6%
0.8%
29
JCO Clinical Cancer Informatics
18 papers in training set
Top 0.8%
0.8%
30
Communications Biology
886 papers in training set
Top 21%
0.8%