A multimodal foundation model for emergency head CT interpretation
Zheng, J.; Chen, Y.; Wu, B.; Wang, Y.; Liu, M.; Li, L.; Jiang, S.; Chen, W.; Xu, L.; Wu, Y.; Liu, C.; Guo, L.; Bai, X.; Li, Z.; Yang, H.; Qin, F.; Liu, J.; Qu, H.; Liao, Q.; Zhao, G.; Pan, K.; Guo, J.; Chen, L.; Zhou, Y.; Sun, H.; Tian, Q.
Show abstract
Non-contrast head CT is the first-line imaging modality for acute neurological emergencies, with demand rising worldwide. However, existing foundation models for head CT interpretation are ill-suited for emergency use because they target general or chronic-disease assessment and optimize reports for lexical overlap rather than the risk-relevant findings central to emergency triage. Here we present CHIEF, a Chinese-language Head CT Interpretation Emergency Foundation model, pretrained on emergency head CT volumes and paired reports with contrastive, generative, and geometry-regularization objectives. Trained and evaluated on 16,563 examinations from seven hospitals, CHIEF achieved an AUROC of 0.9646 for emergency triage and drafted triage-oriented radiology reports, while also supporting image-to-text retrieval for reference-case support and zero-shot abnormality recognition. CHIEF generated reports of substantially higher quality than those from commercial multimodal large language models, which could not be reliably distinguished from human-written ones by radiologists in a blinded Turing test. Overall, CHIEF provides a generalizable foundation for emergency head CT interpretation and radiologist-in-the-loop clinical decision support.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Understanding the robustness of vision-language models to medical image artefacts 96%
- High-Sensitivity Pan-Cancer AI Assessment of Lymph Node Metastasis via Uncertainty Quantification 93%
- Biologically-informed deep neural networks provide quantitative assessment of intratumoral heterogeneity in post-treatment glioblastoma 93%
Similar papers in this journal
- Generative AI Enables Medical Image Segmentation in Ultra Low-Data Regimes 96%
- PHARAOH: A collaborative crowdsourcing platform for PHenotyping And Regional Analysis Of Histology 93%
- STAIG: Spatial Transcriptomics Analysis via Image-Aided Graph Contrastive Learning for Domain Exploration and Alignment-Free Integration 93%
Similar papers in this journal
Similar papers in this journal
- Annotation-free multi-organ anomaly detection in abdominal CT using free-text radiology reports: A multi-center retrospective study 94%
- Transformer-based deep learning model for the diagnosis of suspected lung cancer in primary care based on electronic health record data 92%
- Integrative deep learning analysis improves colon adenocarcinoma patient stratification at risk for mortality 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.