CytoGate-Bench: an LLM benchmark for cross-panel cell gating in cytometry
Kim, J.; Lee, B.; Ahn, N.; Ionita, M.; McKeague, M. L.; Lee, M. E.; Jeong, C.-U.; Apostolidis, S. A.; Baxter, A. E.; Shwetank, ; Greenplate, A. R.; Wherry, E. J.; Sohn, K.-A.; Kim, D.
Show abstract
In cytometry, the workhorse single-cell technology of clinical immunology, every study defines its own antibody panel and cell-type vocabulary, so a classifier trained on one cannot annotate the next. Immunologists instead annotate by manual gating, splitting one parent population at a time on a two-marker plot, down an expert-defined hierarchy. We introduce CytoGate-Bench, a benchmark that reformulates this per-step procedure as a zero-shot, panel-agnostic task for large language models. It comprises 23,646 expert-annotated instances re-curated from 11 public flow- and mass-cytometry cohorts spanning eight marker panels. Across six open- and closed-weight backbones, the strongest formulation draws one rectangular gate per candidate and falls within the range of trained, panel-specialized baselines. It degrades less under distribution shift. Walking the hierarchy stepwise outperforms predicting every cell type at once. Ablations trace the signal to the data distribution shape and curated marker priors. However, adding vision or a self-verification loop systematically tightens gates.
Matching journals
The top 8 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Learning antibody sequence constraints from allelic inclusion 92%
- Learning multi-cellular representations of single-cell transcriptomics data enables characterization of patient-level disease states 92%
- Automated assignment of cell identity from single-cell multiplexed imaging and proteomic data 92%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.