Context-aware Multi-Property Antibody Predictor: a Novel Framework Integrating Text and Protein Language Models
Giancardo, L.; Yilmaz, M.; Lee, E.; Ren, K.; Zhao, Y.; Trang, G.; Sonmez, K.; Cheng, N.
Show abstract
Recent advances in Machine Learning have transformed antibody development through in-silico models, accelerating therapeutic candidate identification. However, challenges persist: rapid adaptation of property predictors to laboratory-specific assays with incomplete datasets; batch effects introducing systematic bias; assay costs necessitating efficient unseen property prediction. We introduce a novel multi-modal architecture featuring specialized tokenization and embedding projection that integrates text and protein language models (pLM) and a learning strategy to enable in-context learning for multi-property prediction without learning shortcuts. Our framework enables prompting without dictionary merging across modalities, creating a compact model capable of in-context learning for multi-property prediction. The orchestrating model avoids pLM-to-text projection while enabling inference-time adaptation without retraining. Using 876,898 antibodies with batch effect simulation, our architecture achieved Spearmans {rho}>0.8 across multiple developability properties, significantly outperforming fine-tuned multimodal-LLMs and showed the ability of leveraging correlation between properties for prediction. This approach has the potential to address critical antibody development challenges.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Accelerating protein engineering with fitness landscape modeling and reinforcement learning 96%
- Evaluating generalizability of artificial intelligence models for molecular datasets 95%
- TrustAffinity: accurate, reliable and scalable out-of-distribution protein-ligand binding affinity prediction using trustworthy deep learning 94%
Similar papers in this journal
- CaLMPhosKAN: Prediction of General Phosphorylation Sites in Proteins via Fusion of Codon Aware Embeddings with Amino Acid Aware Embeddings and Wavelet-based Kolmogorov Arnold Network 96%
- ProteinBERT: A universal deep-learning model of protein sequence and function 96%
- Learning Context-aware Structural Representations to Predict Antigen and Antibody Binding Interfaces 96%
Similar papers in this journal
- AlphaBind, a Domain-Specific Model to Predict and Optimize Antibody-Antigen Binding Affinity 96%
- Towards generalizable prediction of antibody thermostability using machine learning on sequence and structure features 95%
- Humatch - fast, gene-specific joint humanisation of antibody heavy and light chains 94%
Similar papers in this journal
- PLMFit : Benchmarking Transfer Learning with Protein Language Models for Protein Engineering 97%
- Scalable embedding fusion with protein language models: insights from benchmarking text-integrated representations 96%
- CASTER-DTA: Equivariant Graph Neural Networks for Predicting Drug-Target Affinity 95%
Similar papers in this journal
- Focused learning by antibody language models using preferential masking of non-templated regions 95%
- Federated Learning for multi-omics: a performance evaluation in Parkinson's disease 95%
- Discovering nuclear localization signal universe through a novel deep learning model with interpretable attention units 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.