Cause-excluded Effect Evaluation: a framework for the faithful assessment of genetic perturbation target identification
Hu, J.; Qi, X.; Tian, L.; Yan, J.; Liu, N.; Li, X.
Show abstract
Identifying which gene drives a desired cell-state transition is a foundational inverse problem in target discovery and cell-state engineering, yet far less developed than forward prediction. We show that prevailing benchmarks inflate performance through two artefacts: training leakage, where test-perturbation cells are seen during fitting, and evaluation leakage, where the perturbed gene's own expression change exposes the answer. Here, we introduce Cause-excluded Effect Evaluation (CEE), a framework that separates train and test perturbation targets, removes target-gene self-effects from expression profiles and scores candidates in downstream response space. With CEE, we find that simple structure-based methods consistently outperform complex deep learning models across 16 single-cell perturbation datasets, revealing that the recoverable signal is governed by low-rank and additive structure in perturbation responses rather than by model complexity. Our work disentangles evaluation artefacts from genuine predictive capacity and offers a design principle for developing perturbation target identification methods.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Generative Approaches to Kinetic Parameter Inference in Metabolic Networks via Latent Space Exploration 95%
- Sparse Epistatic Regularization of Deep Neural Networks for Inferring Fitness Functions 95%
- CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cells 95%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.