Leveraging Large Language Models to Direct Automated PET/CT Tumour Segmentation in Retrospective Data: an Agentic Framework Method
Bonney, L. M.; Brown, S. L.; Bradley, K. M.; Hassan, A. B.; McGowan, D. R.
Show abstract
Automated medical image segmentation using deep learning requires large labelled datasets, presenting barriers for rare cancers like sarcoma. We developed an agentic framework integrating LLM analysis of radiologist reports with nnUNet segmentation for 18F-FDG PET/CT imaging data (N=60, 134 studies), aiming to improve automated tumour segmentation for retrospective data. LLM interpretation was optimised in an expanded report dataset (N=91, 226 studies). The framework aimed to first screen for disease presence, then tested localising tumours to body regions mapped via automated organ segmentation, enabling targeted image cropping before segmentation. A baseline nnUNet was trained for comparison and achieved a mean Dice of 0.49. The disease classification framework attained mean Dice 0.62, correctly identifying 9/11 disease-free cases versus 6/11 for baseline. This approach demonstrates potential for leveraging routinely collected clinical text data to enhance medical imaging research in rare diseases.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Fully Automated Explainable Abdominal CT Contrast Media Phase Classification Using Organ Segmentation and Machine Learning 95%
- PSMA-Hornet: fully-automated, multi-target segmentation of healthy organs in PSMA PET/CT images 95%
- Necessity and Impact of Specialization of Large Foundation Model for Medical Segmentation Tasks 95%
Similar papers in this journal
- Identifying relationships between imaging phenotypes and lung cancer-related mutation status: EGFR and KRAS 95%
- Effective Deep Learning Approaches for Predicting COVID-19 Outcomes from Chest Computed Tomography Volumes 94%
- Tracking And Predicting COVID-19 Radiological Trajectory Using Deep Learning On Chest X-Rays: Initial Accuracy Testing 94%
Similar papers in this journal
- Enhancing Semantic Segmentation in Chest X-Ray Images through Image Preprocessing: ps-KDE for Pixel-wise Substitution by Kernel Density Estimation 95%
- ai-corona : Radiologist-Assistant Deep Learning Framework for COVID-19 Diagnosis in Chest CT Scans 95%
- Automated Detection of COVID-19 through Convolutional Neural Network using Chest x-ray images 92%
Similar papers in this journal
- Evaluating Large Language Model-Generated Brain MRI Protocols: Performance of GPT4o, o3-mini, DeepSeek-R1 and Qwen2.5-72B 93%
- From Community Acquired Pneumonia to COVID-19: A Deep Learning Based Method for Quantitative Analysis of COVID-19 on thick-section CT Scans 93%
- Assessing GPT-4 Multimodal Performance in Radiological Image Analysis 93%
Similar papers in this journal
- “E Pluribus Unum”: Prospective acceptability benchmarking from the Contouring Collaborative for Consensus in Radiation Oncology (C3RO) Crowdsourced Initiative for Multi-Observer Segmentation 93%
- The Effect of Image Resolution on Automated Classification of Chest X-rays 93%
- Quantifying Epistemic and Aleatoric Uncertainty in 3D U-Net Segmentation 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.