Back

Autonomous generation of decision-grade clinical evidence

Yang, S.; Wu, J.; Xie, H.; Xin, Z.; Wang, W.

2026-07-01 health informatics
10.64898/2026.06.26.26356653 medRxiv
Show abstract

Medical practice is bottlenecked by the slow production of high-quality clinical evidence. Despite progress in automating selected stages, autonomous conduct of the entire research life cycle remains beyond reach. Here we present OpenEBM, the first autonomous system to generate decision-grade clinical evidence by conducting evidence-synthesis research end to end. To enable and evaluate this, we develop OpenEBM-Corpus, a foundation resource of expert-annotated research trajectories that enables training of a specialist model, and OpenEBM-Bench, a multidisciplinary benchmark that evaluates the entire research life cycle. Our compact specialist model generates valid clinical evidence in 90.7% of end-to-end evaluations and matches expert performance across the research trajectory, whereas GPT-5 falls to 3.8% as failures propagate through dependent stages. In blinded evaluations across clinical domains, independent evaluators prefer OpenEBM at multiple stages and cannot distinguish its reasoning traces from expert-conducted work above chance. Applied to a question left unresolved by current guidelines, OpenEBM produces de novo evidence addressing the efficacy and safety of neoadjuvant chemotherapy for locally advanced rectal cancer. OpenEBM brings within reach the founding aspiration of evidence-based medicine and establishes a paradigm for scalable evidence generation.

Matching journals

The top 3 journals account for 50% of the predicted probability mass.

1
npj Digital Medicine
118 papers in training set
Top 0.1%
39.1%
2
Journal of the American Medical Informatics Association
71 papers in training set
Top 0.4%
7.8%
3
Nature Medicine
125 papers in training set
Top 0.1%
7.8%
50% of probability mass above
4
Nature Communications
5641 papers in training set
Top 29%
4.8%
5
iScience
1154 papers in training set
Top 9%
2.7%
6
JCO Clinical Cancer Informatics
22 papers in training set
Top 0.3%
2.4%
7
Clinical Trials
11 papers in training set
Top 0.1%
2.1%
8
Scientific Data
209 papers in training set
Top 1%
1.9%
9
Med
39 papers in training set
Top 0.2%
1.9%
10
BMC Medical Informatics and Decision Making
43 papers in training set
Top 1%
1.7%
11
Scientific Reports
3612 papers in training set
Top 57%
1.7%
12
JMIR Medical Informatics
18 papers in training set
Top 0.5%
1.5%
13
Communications Medicine
113 papers in training set
Top 3%
1.3%
14
Bioinformatics
1204 papers in training set
Top 7%
1.3%
15
The Lancet Digital Health
25 papers in training set
Top 0.5%
1.1%
16
PLOS ONE
5266 papers in training set
Top 58%
1.0%
17
Journal of Clinical Epidemiology
31 papers in training set
Top 0.7%
1.0%
18
GigaScience
212 papers in training set
Top 4%
1.0%
19
Journal of Medical Internet Research
87 papers in training set
Top 2%
1.0%
20
Patterns
78 papers in training set
Top 2%
1.0%
21
Genetics in Medicine
78 papers in training set
Top 0.9%
0.9%
22
npj Antimicrobials and Resistance
11 papers in training set
Top 0.2%
0.8%
23
eBioMedicine
183 papers in training set
Top 6%
0.8%
24
BMJ Health & Care Informatics
15 papers in training set
Top 1.0%
0.8%
25
Annals of Internal Medicine
28 papers in training set
Top 0.7%
0.6%
26
JAMIA Open
42 papers in training set
Top 2%
0.6%
27
Journal of Biomedical Informatics
47 papers in training set
Top 1%
0.6%
28
European Journal of Cancer
11 papers in training set
Top 0.5%
0.6%