Understanding binary classifier model structure based on Shapley feature interaction patterns
Zhao, B.
Show abstract
There is increasing emphasis on the interpretability of machine learning models, including in understanding biological systems. The well-known Shapley value framework based on game theory works in principle with any models to attribute feature importance. While feature interactions are critical to understand and can be interpreted within this framework, much attention is paid in practice on global feature importance and general trends of interactions. The inter-relationships between underlying model structure and Shapley value and its decomposition is less clear. Here we use binary classifiers to systematically examine how logical and additive interactions affect marginal contributions. These decomposed main and interaction effects are reflected in resulting Shapley dependence plots. The directionality of inequalities or logical/additive operators influence independently the main and marginal/interaction effects. Lastly, we show that these principles are applicable for models with noise.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Analytical approach of synchronous and asynchronous update schemes applied to solving biological Boolean networks 95%
- Predicting Adverse Drug Effects: A Heterogeneous Graph Convolution Network with a Multi-layer Perceptron Approach 94%
- An Information-based approach to handle various types of uncertainty in Fuzzy Bodies of Evidence 94%
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- Transfer Learning Models for Bacterial Strain Dissemination Biomarkers using Weighted Non-Parallel Proximal Support Vector Machines 94%
- Modeling relaxation experiments with a mechanistic model of gene expression 93%
- ELIMINATOR: Essentiality anaLysIs using MultIsystem Networks And inTeger prOgRamming 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.