A foundation model learns the sequence and functional grammar of fully human heavy-chain-only antibodies
Nona Biosciences AI4S Team, ; Miao, H.
Show abstract
Antibody language models learn from large natural repertoires, but whether generic representations capture the constraints of specialized antibody formats remains unclear. We first characterized fully human heavy-chain-only antibodies (HCAbs) independently of HCAb-trained models. Source-aware comparisons with conventional human VH domains revealed a reproducible distributional shift localized predominantly to CDR1/2, CDR3 architecture and, where supported, a restricted framework region rather than widespread framework remodeling. These model-independent differences motivated repertoire-specific pretraining. We developed HCAbLM, to our knowledge the first foundation model pretrained specifically on a large-scale fully human HCAb repertoire, using 31.8 million sequences from 73 independently immunized HCAb mice. HCAbLM learned a region-selective sequence-compatibility prior distinct from conventional antibody language models, and its frozen representations transferred to experimentally measured SEC purity, HIC behavior and thermal stability in grouped internal validation and retrospective cross-project evaluation. These findings identify repertoire composition as an important biological design variable for foundation models of specialized antibody formats.
Matching journals
The top 2 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Deep learning assessment of nativeness and pairing likelihood for antibody and nanobody design with AbNatiV2 97%
- In silico proof of principle of machine learning-based antibody design at unconstrained scale 96%
- AlphaBind, a Domain-Specific Model to Predict and Optimize Antibody-Antigen Binding Affinity 95%
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- Discovering novel calcineurin inhibitors through quantitative mapping of protein-peptide affinity landscapes 94%
- Bivalent mRNA booster encoding virus-like particles elicits potent polyclass RBD antibodies in pre-vaccinated mice 93%
- The landscape of antibody binding affinity in SARS-CoV-2 Omicron BA.1 evolution 93%
Similar papers in this journal
- Paraplume: A fast and accurate paratope prediction method provides insights into repertoire-scale binding dynamics 95%
- Supervised fine-tuning of pre-trained antibody language models improves antigen specificity prediction 94%
- THLANet: A Deep Learning Framework for Predicting TCR-pHLA Binding in Immunotherapy Applications 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.