A preliminary study of commercially available general-purpose chest radiography artificial intelligence-based software for detecting airspace opacity lesions in COVID-19 patients
Suzuki, M.; Niimura, A.; Nakamura, Y.; Otsuka, Y.
Show abstract
PurposeTo validate commercially available general-purpose artificial intelligence (AI)-based software for detecting airspace opacity in chest radiographs (CXRs) of COVID-19 patients. Materials and MethodsWe used the ieee8023-covid-chestxray-dataset to validate commercial AI software capable of detecting "Nodule/Mass" and "Airspace opacity" as regions of interest with probability scores. From this dataset, we excluded computed tomography images and CXR images taken using an anteroposterior spine view and analyzed CXR images tagged with "Pneumonia/Viral/COVID-19" and "no findings." A radiologist then reviewed the images and rated them on a 3-point opacity score for the presence of airspace opacity. The maximum probability score of airspace opacity for each image was calculated using this software. The difference in each maximum probability for each opacity score was evaluated using Wilcoxons rank sum test. The threshold of the probability score was determined by receiver operator characteristic curve analysis for the presence or absence of COVID-19, and the true positive rate (TPR) and false positive rate (FPR) were determined for the individual and overall opacity scores. ResultsImages from 342 patients with COVID-19 and 15 normal images were included. Opacity scores of 1, 2, and 3 were observed in 44, 70, and 243 images, respectively, of which 33 (75%), 66 (94.2%), and 243 (100%), respectively, were from COVID-19 patients. The overall TPR and FPR were 0.82 and 0.13, respectively, at an area under the curve of 0.88 and a threshold of 0.06, while the FPR for opacity score 1 was 0.18 and the TPR for score 3 was 0.97. ConclusionUsing a public database containing CXR images of COVID-19 patients, commercial AI software was shown to be able to detect airspace opacity in severe pneumonia. SummaryCommercially available AI software was capable of detecting airspace opacity in CXR images of COVID-19 patients in a public database.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- High-Dimensional Multinomial Multiclass Severity Scoring of COVID-19 Pneumonia Using CT Radiomics Features and Machine Learning Algorithms 96%
- Toward Understanding COVID-19 Pneumonia: A Deep-learning-based Approach for Severity Analysis and Monitoring the Disease 96%
- COVID-Classifier: An automated machine learning model to assist in the diagnosis of COVID-19 infection in chest x-ray images 95%
Similar papers in this journal
- Quantitative analysis of chest computed tomography of COVID-19 pneumonia using a software widely used in Japan 97%
- Accuracy of deep learning based computed tomography diagnostic system of COVID-19: a consecutive sampling external validation cohort study 96%
- ai-corona : Radiologist-Assistant Deep Learning Framework for COVID-19 Diagnosis in Chest CT Scans 95%
Similar papers in this journal
- Passive Microwave Radiometry (MWR) for diagnostics of COVID-19 lung complications in Kyrgyzstan 95%
- Auto-detection of motion artifacts on CT pulmonary angiograms with a physician-trained AI algorithm 95%
- Detection, Isolation and Quantification of Myocardial Infarct with Four Different Histological Staining Techniques 92%
Similar papers in this journal
- Automated airway quantification associates with mortality in idiopathic pulmonary fibrosis 94%
- Assessing GPT-4 Multimodal Performance in Radiological Image Analysis 94%
- Predicting EGFR mutation status in lung adenocarcinoma presenting as ground-glass opacity: utilizing radiomics model in clinical translation 94%
Similar papers in this journal
- Two-Step Machine Learning to Diagnose and Predict Involvement of Lungs in COVID-19 and Pneumonia using CT Radiomics 97%
- The mathematics of erythema: Development of machine learning models for artificial intelligence assisted measurement and severity scoring of radiation induced dermatitis 93%
- Deep learning ensemble for abdominal aortic calcification scoring from lumbar spine X-ray and DXA images 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.