Exact Probability Distribution for the ROC Area Under Curve
Ekstrom, J.; Ogren, J.; Sjoblom, T.
Show abstract
The Receiver Operating Characteristic (ROC) is a de facto standard for determining the accuracy of in vitro diagnostic (IVD) medical devices, and thus exactness in its probability distribution is crucial toward accurate statistical inference. We show the exact probability distribution of the ROC AUC-value, hence exact critical values and p-values are readily obtained. Because the exact calculations are computationally intense, we demonstrate a method of geometric interpolation which is exact in a special case but generally an approximation, vastly increasing computational speeds. The method is illustrated through open access data, demonstrating superiority of 26 composite biomarkers relative to a predicate device. Especially under correction for testing of multiple hypotheses, traditional asymptotic approximations are encumbered by considerable imprecision, adversely affecting IVD device development. The ability to obtain exact p-values will allow more efficient IVD device development.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Analyzing Biomarker Discovery: Estimating the Reproducibility of Biomarker Sets 96%
- Theoretical properties of nearest-neighbor distance distributions and novel metrics for high dimensional bioinformatics data 94%
- Projection in genomic analysis: A theoretical basis to rationalize tensor decomposition and principal component analysis as feature selection tools 93%
Similar papers in this journal
- Accurate Prediction of Breast Cancer Survival through Coherent Voting Networks with Gene Expression Profiling 94%
- Estimating the SARS-CoV-2 infected population fraction and the infection-to-fatality ratio: A data-driven case study based on Swedish time series data 94%
- Selecting the most important self-assessed features for predicting conversion to Mild Cognitive Impairment with Random Forest and Permutation-based methods 94%
Similar papers in this journal
- Empirical methods for the validation of Time-To-Event mathematical models taking into account uncertainty and variability: Application to EGFR+ Lung Adenocarcinoma. 94%
- Modeling relaxation experiments with a mechanistic model of gene expression 94%
- De novo identification of maximally deregulated subnetworks based on multi-omics data with DeRegNet 94%
Similar papers in this journal
- Likelihood-ratio test statistic for the finite-sample case in nonlinear ordinary differential equation models 95%
- Using random forests to uncover the predictive power of distance-varying cell interactions in tumor microenvironments 94%
- Model guided trait-specific co-expression network estimation as a new perspective for identifying molecular interactions and pathways 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.