Back

Benchmarking foundation models for improving confounding control in target trial emulation

Kleper, S. L.; Melamed, R. D.

2026-05-13 epidemiology
10.64898/2026.05.09.26352820 medRxiv
Show abstract

Machine learning models for causal inference aim to adjust for confounding factors that are associated with both an exposure and an outcome, creating a spurious biased association. But, these methods are rarely empirically evaluated to assess their success in mitigating such bias. Recent advances in knowledge representation, including both foundation models and knowledge graphs, could enrich these models, but rigorous evaluations are needed in order to assess their potential. Here, we ask whether enriching existing causal inference models with knowledge representations from foundation models can improve confounding control. Rather than using semi-simulated data to address this question, we focus on examples of real confounding: we emulate target randomized active comparator trials that are subject to confounding by indication. Our results can guide researchers aiming to develop or apply methods for discovering causal effects from observational data.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

1
BMC Medical Research Methodology
47 papers in training set
Top 0.1%
13.1%
2
Clinical Trials
11 papers in training set
Top 0.1%
12.6%
3
Statistics in Medicine
40 papers in training set
Top 0.1%
7.9%
4
eLife
5828 papers in training set
Top 19%
6.2%
5
Journal of Clinical Epidemiology
31 papers in training set
Top 0.1%
6.2%
6
American Journal of Epidemiology
67 papers in training set
Top 0.2%
5.5%
50% of probability mass above
7
PLOS ONE
5266 papers in training set
Top 34%
4.0%
8
Trials
29 papers in training set
Top 0.3%
4.0%
9
Research Synthesis Methods
20 papers in training set
Top 0.1%
4.0%
10
Nature Communications
5641 papers in training set
Top 34%
3.4%
11
Epidemiology
32 papers in training set
Top 0.1%
3.2%
12
PLOS Computational Biology
1863 papers in training set
Top 11%
3.1%
13
International Journal of Epidemiology
88 papers in training set
Top 0.5%
2.6%
14
Pharmacoepidemiology and Drug Safety
18 papers in training set
Top 0.2%
2.4%
15
Biometrics
23 papers in training set
Top 0.1%
2.1%
16
Statistical Methods in Medical Research
11 papers in training set
Top 0.1%
1.9%
17
Value in Health
11 papers in training set
Top 0.2%
1.7%
18
npj Digital Medicine
118 papers in training set
Top 2%
1.7%
19
PLOS Biology
486 papers in training set
Top 9%
1.0%
20
BMC Medicine
176 papers in training set
Top 4%
1.0%
21
Scientific Reports
3612 papers in training set
Top 74%
0.8%
22
Journal of Biomedical Informatics
47 papers in training set
Top 1%
0.8%
23
Epidemics
116 papers in training set
Top 2%
0.6%
24
Medical Decision Making
12 papers in training set
Top 0.5%
0.6%
25
Proceedings of the National Academy of Sciences
2444 papers in training set
Top 45%
0.6%