Back

Soft-Attention Improves Skin Cancer Classification Performance

Datta, S. K.; Shaikh, M. A.; Srihari, S. N.; Gao, M.

2021-06-04 radiology and imaging
10.1101/2021.05.12.21257114 medRxiv
Show abstract

In clinical applications, neural networks must focus on and highlight the most important parts of an input image. Soft-Attention mechanism enables a neural network to achieve this goal. This paper investigates the effectiveness of Soft-Attention in deep neural architectures. The central aim of Soft-Attention is to boost the value of important features and suppress the noise-inducing features. We compare the performance of VGG, ResNet, Inception ResNet v2 and DenseNet architectures with and without the Soft-Attention mechanism, while classifying skin lesions. The original network when coupled with Soft-Attention outperforms the baseline[16] by 4.7% while achieving a precision of 93.7% on HAM10000 dataset [25]. Additionally, Soft-Attention coupling improves the sensitivity score by 3.8% compared to baseline[31] and achieves 91.6% on ISIC-2017 dataset [2]. The code is publicly available at github1.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

1
Nature Machine Intelligence
61 papers in training set
Top 0.1%
28.1%
2
Nature Communications
4913 papers in training set
Top 24%
7.3%
3
Scientific Reports
3102 papers in training set
Top 17%
6.4%
4
Neurocomputing
13 papers in training set
Top 0.1%
6.4%
5
Frontiers in Computational Neuroscience
53 papers in training set
Top 0.6%
3.9%
50% of probability mass above
6
Informatics in Medicine Unlocked
21 papers in training set
Top 0.2%
3.6%
7
Nature Medicine
117 papers in training set
Top 0.8%
3.6%
8
IEEE/ACM Transactions on Computational Biology and Bioinformatics
32 papers in training set
Top 0.1%
3.6%
9
Patterns
70 papers in training set
Top 0.2%
3.6%
10
Communications Medicine
85 papers in training set
Top 0.1%
2.4%
11
Medical Image Analysis
33 papers in training set
Top 0.5%
2.1%
12
Proceedings of the National Academy of Sciences
2130 papers in training set
Top 32%
1.7%
13
Expert Systems with Applications
11 papers in training set
Top 0.1%
1.7%
14
Diagnostics
48 papers in training set
Top 1%
1.7%
15
IEEE Transactions on Medical Imaging
18 papers in training set
Top 0.3%
1.3%
16
npj Precision Oncology
48 papers in training set
Top 0.8%
1.2%
17
Nature Computational Science
50 papers in training set
Top 0.9%
1.2%
18
Computers in Biology and Medicine
120 papers in training set
Top 3%
1.2%
19
PLOS Computational Biology
1633 papers in training set
Top 21%
1.0%
20
IEEE Transactions on Computational Biology and Bioinformatics
17 papers in training set
Top 0.4%
1.0%
21
eBioMedicine
130 papers in training set
Top 3%
1.0%
22
PLOS Digital Health
91 papers in training set
Top 2%
0.9%
23
Science Advances
1098 papers in training set
Top 27%
0.8%
24
Cancers
200 papers in training set
Top 4%
0.8%
25
IEEE Transactions on Biomedical Engineering
38 papers in training set
Top 0.9%
0.8%
26
PLOS ONE
4510 papers in training set
Top 67%
0.8%
27
Journal of Pathology Informatics
13 papers in training set
Top 0.4%
0.8%
28
IEEE Access
31 papers in training set
Top 1.0%
0.8%
29
Journal of Neural Engineering
197 papers in training set
Top 2%
0.7%
30
iScience
1063 papers in training set
Top 40%
0.5%