Disease relevance and replicability of deep learning gene expression prediction
Zhang, A.; Tasaki, S.; Connell, D.; Ng, B.; Gaiteri, C.
Show abstract
Recent deep learning (DL) models predict average gene expression levels from DNA sequences with high overall correlation to measured values. We examine these DL models through the lens of disease research. The seemingly high overall performance of DL models is largely due to capturing whether genes are "On" or "Off", and to a lesser extent, disease-relevant expression level changes for "On" genes. Indeed, the more bimodal the gene expression distribution, the better the reported performance. We track the extent of this issue across tissues, molecular systems, and cancers. Compounding the model evaluation issue, we find inconsistencies between the published code and reported performance, highlighting the importance of versioning and publishing performance evaluation code. These findings indicate that the high reported performance of popular DL models falls unexpectedly short in disease applications, and that the problem of personalized genomic prediction remains far from solved in a disease context.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- Highly Accurate Cancer Phenotype Prediction with AKLIMATE, a Stacked Kernel Learner Integrating Multimodal Genomic Data and Pathway Knowledge 94%
- Representation Learning of Genomic Sequence Motifs with Convolutional Neural Networks 94%
- Accessible, Reproducible, and Scalable Machine Learning for Biomedicine 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.