GATSBI: Improving context-aware protein embeddingsthrough biologically motivated data splits
Nayar, G.; Altman, R. B.
Show abstract
MotivationUnderstanding protein function requires integrating diverse biological evidence while accounting for strong contextual dependence. Recent protein embedding methods increasingly leverage heterogeneous biological networks, yet their evaluation protocols often fail to reflect the specific biological tasks for which the embeddings are intended. Prediction of missing interactions, annotation of new proteins, and discovery of functional modules require fundamentally different data partitions, such as edge-masked versus node-held-out splits. Moreover, most approaches report performance primarily on well-studied proteins, where computational predictions are least needed, risking substantial overestimation of real-world utility. ResultsWe introduce a graph attention-based framework (Gatsbi) to construct context-aware protein embeddings from integrated protein-protein interactions, co-expression, sequence representations, and tissue-specific associations. Using task-aligned evaluation protocols, we show that models trained with biologically appropriate partitions achieve markedly better generalization. Across interaction, function, and functional set prediction, Gatsbi consistently outperforms existing pretrained embeddings for both well-studied and understudied proteins, with the largest gains observed for the understudied regime and under inductive node-held-out evaluation. To enable broad reuse, we provide the learned embeddings for download for application to other protein prediction tasks. Availability and ImplementationCode and models for our experiments are available at https://github.com/Helix-Research-Lab/GATSBI-embedding
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- ICoN: Integration using Co-attention across Biological Networks 97%
- Mining hidden knowledge: Embedding models of cause-effect relationships curated from the biomedical literature 96%
- The axes of biology: a novel axes-based network embedding paradigm to decipher the functional mechanisms of the cell. 95%
Similar papers in this journal
- Tokenized and Continuous Embedding Compressions of Protein Sequence and Structure 96%
- Generating hard-to-obtain information from easy-to-obtain information: applications in drug discovery and clinical inference 95%
- scELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.