Predicting peptide aggregation with protein language model embeddings
Eschbach, E.; Deibler, K.; Korani, D.; Swanson, S. R.
Show abstract
Amyloid fibrils, a form of peptide aggregate, are associated with multiple diseases and hinder the development of therapeutics. The experimental characterization of aggregating peptides is resource-intensive and data are scarce, limiting the development of accurate models. We present a deep-learning model, PALM (Predicting Aggregation with Language Model embeddings), which uses transfer learning to predict aggregation from embeddings extracted from a pretrained protein language model (pLM). PALM is trained on the WaltzDB-2.0 dataset to classify peptides and identify aggregation-prone regions within a sequence at single-residue resolution. Compared to existing models, it exhibits competitive performance on diverse held-out experimental datasets. We find that PALM fails to identify single mutations that increase the rate of aggregation of amyloid beta peptide; however, training the PALM architecture on a larger dataset, CANYA NNK1-3, substantially improves performance in this task. These results show that transfer learning with pLM embeddings improves performance when training on small datasets, but highlight that challenging tasks, such as predicting the effect of single mutations, require more experimental data.
Matching journals
The top 5 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Current challenges for epitope-agnostic TCR interaction prediction and a new perspective derived from image classification 93%
- GraphCPLMQA: Assessing protein model quality based on deep graph coupled networks using protein language model 93%
- INTREPPPID - An Orthologue-Informed Quintuplet Network for Cross-Species Prediction of Protein-Protein Interaction 93%
Similar papers in this journal
Similar papers in this journal
- Positional SHAP (PoSHAP) for Interpretation of Machine Learning Models Trained from Biological Sequences 94%
- Predicting changes in protein thermodynamic stability upon point mutation with deep 3D convolutional neural networks 94%
- THLANet: A Deep Learning Framework for Predicting TCR-pHLA Binding in Immunotherapy Applications 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.