Interpreting Deep Neural Networks Beyond Attribution Methods: Quantifying Global Importance of Genomic Features
Koo, P. K.; Ploenzke, M.
Show abstract
Despite deep neural networks (DNNs) having found great success at improving performance on various prediction tasks in computational genomics, it remains difficult to understand why they make any given prediction. In genomics, the main approaches to interpret a high-performing DNN are to visualize learned representations via weight visualizations and attribution methods. While these methods can be informative, each has strong limitations. For instance, attribution methods only uncover the independent contribution of single nucleotide variants in a given sequence. Here we discuss and argue for global importance analysis which can quantify population-level importance of putative features and their interactions learned by a DNN. We highlight recent work that has benefited from this interpretability approach and then discuss connections between global importance analysis and causality.
Matching journals
The top 2 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- Representation Learning of Genomic Sequence Motifs with Convolutional Neural Networks 96%
- Deep Mendelian Randomization: Investigating the causal knowledge of genomic deep learning models 95%
- Improving deep models of protein-coding potential with a Fourier-transform architecture and machine translation task 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.