Back

Systematic reviews in minutes to hours using artificial intelligence

Bakker, L.; Caganek, T.; Rooprai, A.; Hume, S.

2026-02-10 health informatics
10.64898/2026.02.06.26345764 medRxiv
Show abstract

Systematic reviews are used in academia, biotechnology, pharmaceutical companies and government to synthesise and appraise large numbers of publications. The current (largely manual) workflow takes an average of 9-18 months1, at a cost of $100,000+ per review2. We built a platform, ScholaraAI, that leverages artificial intelligence to cut this to < 0.1% of the time, without compromising quality. ScholaraAI facilitates end-to-end systematic reviews; search, screening, data extraction, and analysis. The workflow is transparent, and the researcher is in the loop. Our approach is compliant with the PRISMA and RAISE frameworks. Compared to a benchmarking set of published systematic reviews, ScholaraAIs sensitivity for correctly included studies is 100% {+/-} 0%, its specificity for correctly excluded studies is 90.8 {+/-} 8.6%, and its accuracy for data extraction is 98.0 {+/-} 3.5%. The time taken per review was 3.67 hours {+/-} 1.26. We used ScholaraAI to produce a novel, up-to-date systematic review and meta-analysis, which is presented here. ScholaraAI is free to try at app.scholara.ai.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

1
Bioinformatics
1061 papers in training set
Top 2%
15.0%
2
Scientific Data
174 papers in training set
Top 0.1%
10.7%
3
Research Synthesis Methods
20 papers in training set
Top 0.1%
8.6%
4
Scientific Reports
3102 papers in training set
Top 16%
6.5%
5
Journal of the American Medical Informatics Association
61 papers in training set
Top 0.4%
6.5%
6
Nature Communications
4913 papers in training set
Top 37%
3.9%
50% of probability mass above
7
npj Digital Medicine
97 papers in training set
Top 1%
3.7%
8
Journal of Medical Internet Research
85 papers in training set
Top 1%
3.7%
9
JAMIA Open
37 papers in training set
Top 0.5%
2.7%
10
JAMA
17 papers in training set
Top 0.1%
2.4%
11
PLOS ONE
4510 papers in training set
Top 47%
2.1%
12
Data in Brief
13 papers in training set
Top 0.1%
1.9%
13
Nature Human Behaviour
85 papers in training set
Top 2%
1.7%
14
BMC Bioinformatics
383 papers in training set
Top 4%
1.7%
15
Nature Computational Science
50 papers in training set
Top 0.8%
1.4%
16
Wellcome Open Research
57 papers in training set
Top 1%
1.3%
17
Journal of Clinical Epidemiology
28 papers in training set
Top 0.4%
1.1%
18
Patterns
70 papers in training set
Top 2%
1.1%
19
JCO Clinical Cancer Informatics
18 papers in training set
Top 0.7%
1.0%
20
Annals of Internal Medicine
27 papers in training set
Top 0.7%
0.9%
21
The Lancet Digital Health
25 papers in training set
Top 0.9%
0.8%
22
International Journal of Medical Informatics
25 papers in training set
Top 2%
0.8%
23
Philosophical Transactions of the Royal Society B
51 papers in training set
Top 5%
0.8%
24
European Journal of Epidemiology
40 papers in training set
Top 0.8%
0.7%
25
Frontiers in Digital Health
20 papers in training set
Top 1%
0.7%
26
Nature
575 papers in training set
Top 16%
0.7%
27
GigaScience
172 papers in training set
Top 4%
0.7%
28
GENETICS
189 papers in training set
Top 2%
0.5%
29
BMC Medicine
163 papers in training set
Top 9%
0.5%
30
Clinical and Translational Science
21 papers in training set
Top 1%
0.5%