De novo generation of antibody CDRH3 with a pre-trained generative large language model

Artificial Intelligence (AI) techniques have made great advances in assisting antibody design. However, antibody design still heavily relies on isolating antigen-specific antibodies from serum, which is a resource-intensive and time-consuming process. To address this issue, we propose a Pre-trained Antibody generative large Language Model (PALM) for the de novo generation of artificial antibodies heavy chain complementarity-determining region 3 (CDRH3) with desired antigen-binding specificity, reducing the reliance on natural antibodies. We also build a high-precision model antigen-antibody binder (A2binder) that pairs antigen epitope sequences with antibody sequences to predict binding specificity and affinity. PALM-generated antibodies exhibit binding ability to SARS-CoV-2 antigens, including the emerging XBB variant, as confirmed through in-silico analysis and in-vitro assays. The in-vitro assays validated that PALM-generated antibodies achieve high binding affinity and potent neutralization capability against both wild-type and XBB spike proteins of SARS-CoV-2. Meanwhile, A2binder demonstrated exceptional predictive performance on binding specificity for various epitopes and variants. Furthermore, by incorporating the attention mechanism into the PALM model, we have improved its interpretability, providing crucial insights into the fundamental principles of antibody design.