Back

sfate: Schur-free, target-conditioned absorption probabilities for scalable single-cell fate analysis

Zeng, W.; Shi, L.

2026-09-25 bioinformatics
10.64898/2026.09.19.752930 bioRxiv
Show abstract

Motivation: Single-cell fate mapping at atlas scale is constrained by memory: in the tested CellRank 2.3.2 pip environment without the optional PETSc/SLEPc stack, the GPCCA estimator fell back--after a warning--to a dense Brandts Schur routine. Across three measured sizes, its peak memory was consistent with ~72 n^2 bytes, a model that back-calculates to ~405 GB [BACK-CALCULATED] for the 74,984-cell dataset studied here--beyond any consumer workstation. Results: We present scalable-fate (sfate), which computes absorption probabilities to annotation-defined target states--where 'fate probability' denotes absorption probability toward user-defined target states on a latent-space transition graph, conceptually related to Palantir-style diffusion-based Markov-chain fate modeling rather than a velocity-derived lineage probability--from latent-space kNN graphs via column-wise GMRES solves, without any Schur decomposition. Memory scaled linearly with cell number over four measured graph-construction tiers (R^2 = 0.9985; 4.03 GiB at 500,000 synthetic cells in 66.2 s); the 500k absorption solve did not converge under the default configuration, so the largest measured full-pipeline scale is the 75k real-data run (1.76 GiB). Solutions agree with float64 direct references within the prespecified 1e-5 tolerance at every tested configuration (production default L-inf = 1.74e-06; best tested configuration 3.21e-07, 31x below the threshold), and reproduce CellRank's fate probabilities when the transition kernel and terminal representative cells are held identical. On 75k mouse 5xFAD/Cd28-cKO microglia (Ayata et al., 2025; GEO: GSE296768), the full analysis ran at 1.76 GiB peak memory, returning a six-state annotation-defined absorption landscape where the archived CellRank analysis returned three comparable arms; a controlled 2x2 comparison identifies terminal-state selection as an important contributor to the cross-tool discrepancy. Availability: sfate is available at https://github.com/Ericleo-zeng/sfate (release v1.0.0, commit 5472f62; MIT license) and is archived at Zenodo (DOI: 10.5281/zenodo.22851715). The repository includes the source code, the validation suite (32 unit tests, deterministic under fixed seed), all benchmark and figure-generation scripts, the synthetic fixtures, and the records underlying every figure and table. Contact: Wei Zeng (ericleo_zeng@hotmail.com)

Matching journals

The top 3 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.