Back

Shortkit-ML: A Unified Multi-Perspective Framework for Detecting Shortcut Learning in Medical Imaging Embeddings

Cajas, S.; Marzullo, A.; Kapadia, S.; Santos, F.; Ocampo Osorio, F.; Kong, Q.; Quarta, A.; Kuo, P.-C.; Patel, M.; Rojas Sillery, R. I.; Celi, L. A.

2026-04-30 health informatics
10.64898/2026.04.29.26352053 medRxiv
Show abstract

AO_SCPLOWBSTRACTC_SCPLOWShortcut learning poses a significant challenge in clinical artificial intelligence, as models may rely on spurious signals rather than clinically relevant features, leading to biased predictions and poor generalization. Existing detection methods are fragmented and lack systematic evaluation across datasets and model architectures. To address this issue, we propose ShortKit-ML, an open-source Python framework for unified shortcut analysis in embedding spaces. The framework integrates over 20 detection methods and six mitigation strategies within a modular pipeline, encompassing embedding analysis, fairness metrics, training dynamics, causal methods, explainability, and representation analysis. We evaluate the framework on chest X-ray datasets (CheXpert and MIMIC-CXR), synthetic benchmarks, and an out-of-domain dataset (CelebA). Experimental results demonstrate that multi-method auditing provides more stable and interpretable evidence than individual methods, while detector disagreement reveals meaningful representational differences. The proposed framework offers automated reporting, interactive visualization, and is available as a pip-installable package. The source code and documentation are publicly available at https://github.com/criticaldata/ShortKit-ML and https://criticaldata.github.io/ShortKit-ML/.

Matching journals

The top 9 journals account for 50% of the predicted probability mass.

1
Medical Image Analysis
35 papers in training set
Top 0.1%
7.6%
2
Nature Machine Intelligence
70 papers in training set
Top 0.3%
7.0%
3
Frontiers in Artificial Intelligence
20 papers in training set
Top 0.1%
6.0%
4
npj Digital Medicine
118 papers in training set
Top 1.0%
6.0%
5
Journal of the American Medical Informatics Association
71 papers in training set
Top 0.7%
5.3%
6
BMC Medical Informatics and Decision Making
43 papers in training set
Top 0.4%
5.3%
7
Scientific Reports
3612 papers in training set
Top 18%
5.3%
8
Patterns
78 papers in training set
Top 0.3%
4.7%
9
Artificial Intelligence in Medicine
17 papers in training set
Top 0.1%
4.7%
50% of probability mass above
10
Computers in Biology and Medicine
128 papers in training set
Top 1%
3.4%
11
PLOS ONE
5266 papers in training set
Top 37%
3.3%
12
PLOS Digital Health
106 papers in training set
Top 2%
3.1%
13
Nature Communications
5641 papers in training set
Top 39%
2.5%
14
IEEE Journal of Biomedical and Health Informatics
37 papers in training set
Top 0.4%
2.5%
15
Biology Methods and Protocols
61 papers in training set
Top 0.5%
2.4%
16
JCO Clinical Cancer Informatics
22 papers in training set
Top 0.3%
2.3%
17
Computer Methods and Programs in Biomedicine
28 papers in training set
Top 0.4%
1.8%
18
BMC Medical Research Methodology
47 papers in training set
Top 0.8%
1.4%
19
JAMIA Open
42 papers in training set
Top 1%
1.4%
20
Brain Informatics
10 papers in training set
Top 0.1%
1.4%
21
IEEE Transactions on Medical Imaging
21 papers in training set
Top 0.4%
1.1%
22
PLOS Computational Biology
1863 papers in training set
Top 18%
1.0%
23
Frontiers in Bioinformatics
49 papers in training set
Top 2%
0.8%
24
Nature Medicine
125 papers in training set
Top 4%
0.8%
25
Journal of Biomedical Informatics
47 papers in training set
Top 1%
0.8%
26
IEEE Transactions on Biomedical Engineering
40 papers in training set
Top 1%
0.8%
27
Frontiers in Medicine
120 papers in training set
Top 4%
0.8%
28
eBioMedicine
183 papers in training set
Top 7%
0.8%
29
European Heart Journal - Digital Health
18 papers in training set
Top 1%
0.8%
30
Biomedical Signal Processing and Control
22 papers in training set
Top 0.7%
0.8%