Direction-Driven Feature Engineering for Low-Data BiologicalClassification
Qurashi, S. U.
Show abstract
We present Topology-Driven Directed Flow (TDDF), a practical feature engineering method for biological classification in low-data regimes. Inspired by the metaphor of water flowing through a straw leaning toward a fixed destination, TDDFextracts three interpretable features from high-dimensional biological space (1) flow coordinate along a learned direction field, (2) shape feature capturing local geometric deviations, and (3) topology feature encoding neighborhood structure. TDDFis a synthesis of established techniques (Fishers LDA, residual analysis, local density estimation) applied with biological insight. Applied to TCGA breast cancer data, TDDFachieved 0.992 AUC (95% CI: [0.988, 0.997], p-value= 0.001) in distinguishing tumor from normal tissue--significantly outperforming raw features (0.985 AUC) and PCA (0.980 AUC). The learned direction field automatically identified known luminal breast cancer genes (ESR1: r = 0.876, p-value{inverted exclamation} 0.001; GATA3: r = 0.823, p-value{inverted exclamation} 0.001). Most critically, TDDFdemonstrated superior performance in low-data regimes, achieving 0.852 AUC with only 50 training samples compared to 0.783 for XGBoost. Code and full statistical validation are available at https://github.com/ubaidqurashi1/topologydriven.
Matching journals
The top 2 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Using random forests to uncover the predictive power of distance-varying cell interactions in tumor microenvironments 95%
- Learning massive interpretable gene regulatory networks of the human brain by merging Bayesian Networks 95%
- Reconstruction Set Test (RESET): a computationally efficient method for single sample gene set testing based on randomized reduced rank reconstruction error 94%
Similar papers in this journal
- Identification of Significant Gene Expression Changes in Multiple Perturbation Experiments using Knockoffs 96%
- Evaluation of out-of-distribution detection methods for data shifts in single-cell transcriptomics 96%
- Species-Agnostic Transfer Learning for Cross-species Transcriptomics Data Integration without Gene Orthology 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.