PINDER: The protein interaction dataset and evaluation resource
Kovtun, D.; Akdel, M.; Goncearenco, A.; Zhou, G.; Holt, G.; Baugher, D.; Lin, D.; Adeshina, Y.; Castiglione, T.; Wang, X.; Marquet, C.; McPartlon, M.; Geffner, T.; Corso, G.; Stark, H.; Carpenter, Z.; Kucukbenli, E.; Bronstein, M.; Naef, L.
Show abstract
Protein-protein interactions (PPIs) are fundamental to understanding biological processes and play a key role in therapeutic advancements. As deep-learning docking methods for PPIs gain traction, benchmarking protocols and datasets tailored for effective training and evaluation of their generalization capabilities and performance across real-world scenarios become imperative. Aiming to overcome limitations of existing approaches, we introduce PINDER, a comprehensive annotated dataset that uses structural clustering to derive non-redundant interface-based data splits and includes holo (bound), apo (unbound), and computationally predicted structures. PINDER consists of 2,319,564 dimeric PPI systems (and up to 25 million augmented PPIs) and 1,955 high-quality test PPIs with interface data leakage removed. Additionally, PINDER provides a test subset with 180 dimers for comparison to AlphaFold-Multimer without any interface leakage with respect to its training set. Unsurprisingly, the PINDER benchmark reveals that the performance of existing docking models is highly overestimated when evaluated on leaky test sets. Most importantly, by retraining DiffDock-PP on PINDER interface-clustered splits, we show that interface cluster-based sampling of the training split, along with the diverse and less leaky validation split, leads to strong generalization improvements.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- ArtiDock: accurate Machine Learning approach to protein-ligand docking optimized for high-throughput virtual screening 96%
- Sampling and ranking of protein conformations using machine learning techniques do not improve quality of rigid protein-protein docking 95%
- PymolFold: A PyMOL Plugin for API-driven Structure Prediction and Quality Assessment 95%
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.