A Hybrid Framework for Accurate Melanoma Diagnosis: Leveraging Generative AI with Enhanced CNN+ Architectures
Wu, Y.; Zhang, B.; Yan, Y.; Li, J.; Wu, Y.; Kim, S. S.; Huang, K.; Ye, Q.; Yu, Y.; Tong, G.
Show abstract
Melanocytes become cancerous, forming tumors that may invade and destroy the surrounding tissues. When melanocytes acquire invasive characteristics, the anchored melanoma begins to damage the normal cells. Therefore, early intervention and diagnosis are essential to avoid high morbidity and mortality in malignant melanoma. However, It is challenging to distinguish the difference between malignant melanoma and benign clump of melanocytes. Based on a data set of 10,000 melanocyte tumors, this paper develops a new model system to improve the accuracy of distinguishing between benign and malignant melanocytes. In the first stage, the original CNN architectures are used, such as ResNet18, ResNet50, VGG11, and VGG16. Synthetic medical images, generated via a Diffusion Model to extract informative features from the original dataset, are used to train the CNN architectures. This approach improves classification accuracy from 91.1% to 92.9%. In the second stage, the fully connected layer of each neural network is replaced with a high-level classifier, XGBoost, to perform secondary classification. This hybrid strategy further enhances performance, achieving up to 93.3% accuracy by using the synthetic images.
Matching journals
The top 7 journals account for 50% of the predicted probability mass.