A large language model-assisted workflow for generating a living evidence base for climate-sensitive foodborne disease
Elson, R.; McIntyre, K. M.; Hardingham, M. B.; Luechtefeld, T.; Lake, I. R.
Show abstract
Abstract Climate change is altering environmental conditions that influence foodborne disease transmission, yet traditional systematic reviews cannot keep pace with expanding evidence. We assessed whether an LLM-assisted workflow could generate a rapid, repeatable, and policy-relevant living evidence base for climate-sensitive foodborne disease. We combined structured PubMed searches (2010-2023), gold-standard human labelling, and iterative refinement of a GPT?4?Turbo?based auto-labeller within the SysRev platform. Pathogens of public-health importance in England were selected a priori. Model performance was evaluated against human reviewers using recall, precision, specificity, accuracy, and balanced accuracy. The refined inclusion model achieved 89{middle dot}2% recall, 59{middle dot}2% precision, 84{middle dot}5% specificity, and 85{middle dot}4% accuracy across 1,044 screened abstracts, identifying 436 studies for inclusion. Post-hoc re-evaluation of discordant abstracts showed that records excluded by the model but included during initial human screening did not meet the refined inclusion criteria. Frequently identified climate exposures included rainfall, temperature, seasonality, and humidity; norovirus, Salmonella, Campylobacter, and Cryptosporidium were the most common pathogens. An LLM-assisted workflow can generate living evidence for climate-sensitive foodborne disease with high recall and improved screening consistency. The approach is scalable, auditable, and suitable for secure institutional environments, supporting horizon scanning and climate-health risk assessment.
Matching journals
The top 9 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Outbreaks of publications about emerging infectious diseases: the case of SARS-CoV-2 and Zika virus 92%
- Quantitative bias analysis for mismeasured variables in health research: a review of software tools 92%
- Evaluation of SURUS: a Named Entity Recognition System to Extract Knowledge from Interventional Study Records 91%
Similar papers in this journal
- The incubation period of COVID-19: A rapid systematic review and meta-analysis of observational research 92%
- The Health Effects of Climate Change: An Overview of Systematic Reviews 92%
- Protocol for the development of a tool (INSPECT-SR) to identify problematic randomised controlled trials in systematic reviews of health interventions 92%
Similar papers in this journal
- Investigation of bias due to selective inclusion of study effect estimates in meta-analyses of nutrition research 93%
- Development of a search filter to retrieve reports of interrupted time series studies from MEDLINE and PubMed 93%
- Evaluation of the sensitivity, accuracy and currency of the Cochrane COVID-19 Study Register for supporting rapid evidence synthesis production 92%
Similar papers in this journal
- Modelling the impact of behavioural interventions during pandemics: A systematic review 91%
- Exploring scalable assessment methods for terminated trials in ClinicalTrials.gov: A cohort analysis of German and Californian trials 91%
- COVID-19-related research data availability and quality according to the FAIR principles: A meta-research study 90%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.