Back

Spatial Agent-Based Modeling and Interpretable Machine Learning Predict Combination Therapy Response in HER2-Heterogeneous Breast Cancer

Rahman, N.; Jackson, T. L.

2026-03-17 cancer biology
10.64898/2026.03.14.711774 bioRxiv
Show abstract

HER2 heterogeneity and reversible phenotypic plasticity play a central role in breast cancer progression and therapeutic resistance, yet how their interaction shapes treatment response remains poorly understood. Experimental and clinical evidence indicates that HER2-positive and HER2-negative tumor cell states can dynamically interconvert, enabling compensatory population shifts that undermine monotherapies targeting a single phenotype. Because stochastic lineage effects, phenotypic switching, and local cell interactions are averaged out in mean-field population-level ODE models, we develop a spatially resolved agent-based model (ABM) that explicitly represents individual-cell dynamics and heterogeneous tumor growth. The model incorporates phenotype-specific proliferation, migration, and death, division-coupled HER2 state transitions, and therapy-induced selective pressures. We consider two therapeutic interventions with complementary mechanisms of action: paclitaxel, which preferentially suppresses HER2-positive proliferation, and Notch inhibition, which targets HER2-negative populations and alters phenotypic composition. Starting from single-cell lineages, we validate the ABM against theoretical predictions from a population-level switching model and against single-cell-derived experimental measurements, demonstrating quantitative agreement with early lineage dynamics and long-term phenotypic equilibria. Simulation results show that monotherapies induce compensatory phenotypic shifts and spatial reorganization that permit tumor persistence. In contrast, combination therapy simultaneously targeting HER2-positive and HER2-negative populations disrupts phenotypic replenishment, fragments spatial structure, and can achieve sustained tumor control across a broad range of treatment strengths. To quantify robustness across heterogeneous tumor parameter regimes, we pair the ABM with an interpretable Random Forest surrogate trained on ensemble simulation data. Using only pre-treatment and early-trajectory features, the surrogate predicts long-term response, identifies growth-rate asymmetries as dominant drivers of resistance, and interpolates across previously unseen parameter combinations within the sampled domain. Together, this integrated mechanistic and data-driven framework clarifies how HER2-mediated plasticity, spatial organization, and competitive growth dynamics shape therapy resistance and provides a scalable approach for predicting and optimizing treatment strategies in HER2-heterogeneous breast cancer. Sample MATLAB code for the agent-based model (ABM) used in this study is available on GitHub.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

1
PLOS Computational Biology
1633 papers in training set
Top 0.4%
26.3%
2
Cancer Research
116 papers in training set
Top 0.1%
10.2%
3
Proceedings of the National Academy of Sciences
2130 papers in training set
Top 9%
6.9%
4
Cell Systems
167 papers in training set
Top 2%
6.5%
5
Scientific Reports
3102 papers in training set
Top 30%
4.0%
50% of probability mass above
6
Nature Communications
4913 papers in training set
Top 39%
3.6%
7
npj Systems Biology and Applications
99 papers in training set
Top 0.5%
3.6%
8
Cell Reports
1338 papers in training set
Top 14%
3.6%
9
PLOS ONE
4510 papers in training set
Top 44%
2.8%
10
Clinical Cancer Research
58 papers in training set
Top 0.7%
2.4%
11
eLife
5422 papers in training set
Top 33%
2.4%
12
Bulletin of Mathematical Biology
84 papers in training set
Top 0.9%
1.9%
13
iScience
1063 papers in training set
Top 19%
1.3%
14
Nature
575 papers in training set
Top 12%
1.3%
15
npj Digital Medicine
97 papers in training set
Top 3%
1.2%
16
Cell Reports Medicine
140 papers in training set
Top 6%
1.0%
17
Science Advances
1098 papers in training set
Top 26%
0.9%
18
Genome Medicine
154 papers in training set
Top 7%
0.9%
19
Communications Biology
886 papers in training set
Top 23%
0.8%
20
Cancer Research Communications
46 papers in training set
Top 1%
0.8%
21
Patterns
70 papers in training set
Top 3%
0.7%
22
Cancers
200 papers in training set
Top 5%
0.7%
23
Nature Biomedical Engineering
42 papers in training set
Top 2%
0.7%
24
Communications Medicine
85 papers in training set
Top 1%
0.7%
25
Physical Review X
23 papers in training set
Top 0.7%
0.7%
26
Breast Cancer Research
32 papers in training set
Top 0.6%
0.5%
27
NAR Genomics and Bioinformatics
214 papers in training set
Top 5%
0.5%
28
Journal for ImmunoTherapy of Cancer
64 papers in training set
Top 1%
0.5%
29
Cellular and Molecular Bioengineering
21 papers in training set
Top 0.5%
0.5%
30
npj Precision Oncology
48 papers in training set
Top 2%
0.5%