Multimodal Diverse Granularity Fusion Network based on US and CT Images for Lymph Node Metastasis Prediction of Thyroid Carcinoma
Li, G.; Yao, J.; Peng, C.; Hu, Y.; Zhao, S.; Feng, X.; Yang, J.; Xu, D.; Li, X.; Sha, C.; He, M.
Show abstract
Accurately predicting the risk of cervical lymph node metastasis (LNM) is crucial for surgical decision-making in thyroid cancer patients, and the difficulty in it often leads to over-treatment. Ultrasound (US) and computed tomography (CT) are two primary non-invasive methods applied in clinical practice, but both contain limitations and provide unsatisfactory results. To address this, we developed a robust and explainable multimodal deep-learning model by integrating the above two examinations. Using 3522 US and 7649 CT images from 1138 patients with biopsy-confirmed LNM status, we showed that multimodal methods outperformed unimodal counterparts at both central and lateral cervical sites. By incorporating a diverse granularity fusion module, we further enhanced the area under the curve (AUC) to 0.875 and 0.859 at central and lateral cervical sites respectively. This performance was also validated in an external cohort. Additionally, we quantified the modality-specific contributions for each nodule and systematically evaluated the applicability across various clinical characteristics, aiding in identifying individuals who can benefit most from the multimodal method.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Deep learning ensemble for abdominal aortic calcification scoring from lumbar spine X-ray and DXA images 93%
- The mathematics of erythema: Development of machine learning models for artificial intelligence assisted measurement and severity scoring of radiation induced dermatitis 93%
- MultiHeadGAN: A Deep Learning Method for Low Contrast Retinal Pigment Epithelium Cells Segmentation in Fluorescent Flatmount Microscopy Images 93%
Similar papers in this journal
- Segmentation of Pancreatic Ductal Adenocarcinoma (PDAC) and surrounding vessels in CT images using deep convolutional neural networks and Texture Descriptors 95%
- Generating synthetic data in digital pathology through diffusion models: a multifaceted approach to evaluation 94%
- Aggregation of Cohorts for Histopathological Diagnosis with Deep Morphological Analysis 94%
Similar papers in this journal
- ai-corona : Radiologist-Assistant Deep Learning Framework for COVID-19 Diagnosis in Chest CT Scans 94%
- Unsupervised Neural Network-Based Image Stitching Method for Bladder Endoscopy 94%
- Enhancing Semantic Segmentation in Chest X-Ray Images through Image Preprocessing: ps-KDE for Pixel-wise Substitution by Kernel Density Estimation 94%
Similar papers in this journal
- piNET: An Automated Proliferation Index Calculator Framework for Ki67 Breast Cancer Images 94%
- Breast invasive ductal carcinoma classification on whole slide images with weakly-supervised and transfer learning 94%
- Prediction of radiation-induced hypothyroidism using radiomic data analysis does not show superiority over standard normal tissue complication models 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.