Back

Benchmarking AI Protein Structure Predictors Reveals a Persistent Bias in Multi-State Proteins

Ye, M.; Wang, Y.-H.; Brogi, M.; Parks, J. M.; Kuo, K. M.; Gumbart, J. C.

2026-07-11 biophysics
10.64898/2026.07.10.737860 bioRxiv
Show abstract

Protein structure predictors achieve high single-state accuracy, but it remains unclear whether they can recover functionally relevant conformational ensembles or account for the presence of ligands and/or binding partners. Here, we benchmark AlphaFold3, Boltz-2, Chai-1, and BioEmu on four canonical multi-state proteins (Pf-MATE, LAO, SecA, and {beta}2AR), quantifying state bias and sampling breadth against experimental reference structures. Models frequently default to a dominant state represented in the PDB; small-molecule ligands have weak or inconsistent effects, while large protein partners drive clear conformational switching between states. Multiple sequence alignment (MSA)-based approaches (AF-Cluster and random subsampling) recapitulate similar biases, indicating that this behavior is not unique to newer architectures. These results underscore current limitations for multi-state protein structure prediction and structure-guided ligand discovery. TOC Graphic O_FIG O_LINKSMALLFIG WIDTH=200 HEIGHT=111 SRC="FIGDIR/small/737860v1_ufig1.gif" ALT="Figure 1"> View larger version (12K): org.highwire.dtl.DTLVardef@3bf389org.highwire.dtl.DTLVardef@1f1c436org.highwire.dtl.DTLVardef@188ea8aorg.highwire.dtl.DTLVardef@1de236e_HPS_FORMAT_FIGEXP M_FIG C_FIG

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

1
Protein Science
246 papers in training set
Top 0.1%
18.5%
2
Structure
193 papers in training set
Top 0.1%
13.0%
3
Journal of Chemical Information and Modeling
238 papers in training set
Top 0.7%
7.9%
4
Proceedings of the National Academy of Sciences
2444 papers in training set
Top 6%
6.7%
5
Nature Communications
5641 papers in training set
Top 27%
5.5%
50% of probability mass above
6
Proteins: Structure, Function, and Bioinformatics
88 papers in training set
Top 0.2%
5.2%
7
Nature Methods
385 papers in training set
Top 2%
4.3%
8
eLife
5828 papers in training set
Top 32%
3.4%
9
Biophysical Journal
631 papers in training set
Top 2%
3.2%
10
Journal of Molecular Biology
232 papers in training set
Top 1%
2.4%
11
Bioinformatics
1204 papers in training set
Top 6%
2.1%
12
Journal of Chemical Theory and Computation
140 papers in training set
Top 0.7%
1.9%
13
PLOS Computational Biology
1863 papers in training set
Top 13%
1.9%
14
IUCrJ
32 papers in training set
Top 0.2%
1.7%
15
Nature
645 papers in training set
Top 6%
1.7%
16
Communications Biology
993 papers in training set
Top 16%
1.5%
17
The Journal of Physical Chemistry B
167 papers in training set
Top 1%
1.3%
18
PLOS ONE
5266 papers in training set
Top 55%
1.1%
19
Cell Systems
201 papers in training set
Top 4%
1.0%
20
The Journal of Physical Chemistry Letters
63 papers in training set
Top 0.7%
0.8%
21
Scientific Reports
3612 papers in training set
Top 74%
0.8%
22
Physical Review Letters
47 papers in training set
Top 0.4%
0.8%
23
Biochemistry
148 papers in training set
Top 2%
0.8%
24
Biomolecules
100 papers in training set
Top 3%
0.6%
25
Acta Crystallographica Section D Structural Biology
59 papers in training set
Top 0.6%
0.6%