Clinical pathogen adjudication in metagenomic sequencing using a large language model
Wei, M.; Zhao, Y.; Fang, C.; Zhang, S.; Xu, K.; Li, S.; Liu, L.; Pang, Y.; Liang, L.; Deng, Z.; Li, M.
Show abstract
Clinical metagenomic sequencing detects hundreds of organisms whose relevance to infection requires clinicians' manual interpretation. We retrospectively reviewed 4,855 specimens from 19 sampling sites, linked 1.33 million detected organisms to clinical culprit-pathogen determinations, and fine-tuned a large language model on these labels. The model recovered 92.44% of reference culprit calls in the held-out test set and 84.49% in a later cohort. In a blinded re-adjudication of 215 cases, the model matched 90.5% of culprit calls on which both expert reviewers agreed. Adjudication accuracy varied with organism identity and specimen types. mNGS-derived metrics such as read counts or genome coverage alone were insufficient to identify culprit pathogens, and organisms classified as common colonizers could still be judged causative. Certain organisms were frequently co-reported as causative in the same specimen. These findings support further evaluation of human and AI-assisted report review, particularly regarding missed pathogens, excess calls, and differences across specimen types.
Matching journals
The top 9 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Clinical Metagenomic Sequencing for Species Identification and Antimicrobial Resistance Prediction in Orthopaedic Device Infection 92%
- Distinct origins and transmission pathways of bla KPC Enterobacterales across three U.S. states 92%
- Metagenomic sequencing as a clinical diagnostic tool for infectious diseases: a systematic review and meta-analysis 91%
Similar papers in this journal
- Systematic evaluation of metatranscriptomic differential gene expression in silico, in vitro, and in vivo enables elucidation of inter-species cross-feeding 92%
- A metagenomic DNA sequencing assay that is robust against environmental DNA contamination 92%
- Genomic dissection of the bacterial population underlying Klebsiella pneumoniae infections in hospital patients: insights into an opportunistic pathogen 92%
Similar papers in this journal
- Establishment and comparative genomics of a high-quality collection of mosquito-associated bacterial isolates -- MosAIC (Mosquito-Associated Isolate Collection) 91%
- Viral dynamics of acute SARS-CoV-2 infection 89%
- An endosymbiont harvest: Phylogenomic analysis of Wolbachia genomes from the Darwin Tree of Life biodiversity genomics project 89%
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.