Back

Harnessing Generative Pre-trained Transformer for Antimicrobial Peptide Generation and MIC Prediction with Contrastive Learning

Hu, K.; Xiao, Y.; Liu, X.; Ma, S.

2025-03-12 bioinformatics
10.1101/2025.03.07.642021 bioRxiv
Show abstract

Antimicrobial peptides (AMPs) have garnered considerable attention due to their reduced likelihood of inducing resistance in pathogens compared to traditional antibiotics, which has spurred the interest in de novo design of AMPs. Despite the availability of various methods, accurately generating AMPs and predicting their inhibitory effects remains a challenging task. In this work, we introduce AMPCLGPT, a novel approach that leverages contrastive learning and generative pre-training for AMP design and minimum inhibitory concentration (MIC) prediction. First, AMPCLGPT is pre-trained on a large-scale unlabeled peptide dataset to learn peptide sequence patterns and enhance its ability to extract powerful representations. Second, the pre-trained AMPCLGPT is fine-tuned on AMP data with contrastive learning to increase the distance between antimicrobial and non-antimicrobial peptides in the latent space, improving its ability to accurately generate AMPs. Additionally, the pre-trained AMPCLGPT is fine-tuned to predict MIC values based on the learned peptide features. Empirical results demonstrate that our model can effectively generate AMPs and accurately predict their MIC values. By integrating these two capabilities, AMPCLGPT enables fully automated design of AMPs with low MIC values. AMPCLGPT represents a significant advancement in the field of AMP research, potentially accelerating the development of potent AMP-based therapeutics.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.