Topological attention asymmetry in ESM-2 attention implicitly encodes the allosteric hierarchy of the adenosine A2A receptor
Moya-Garcia, A. A.
Show abstract
Protein language models (PLMs) learn complex structural and functional dependencies from evolutionary sequence variation alone. While these models lack a temporal axis, it remains an open question whether their static attention maps encode the directional hierarchies characteristic of allosteric communication. We investigate this in the human adenosine A2A receptor using the ESM-2 transformer. We show that attention heads tuned to functional sites exhibit elevated structural asymmetry compared to the background. Using random-site and sequence-shuffle controls, we establish that this asymmetry is not an architectural artefact of the softmax operation, but a learned, sequence-dependent signal. By defining a signed pathway score between the extracellular ligand-binding triad and the intracellular G-protein interface, we identify a robust topological polarity: the model consistently routes information from the dynamic extracellular site to the conserved intracellular interface. This directed bias emerges with network depth and is independent of intrinsic column-sink heads. Rather than simulating a forward-propagating physical wave, the network represents allosteric coupling by utilising the effector site as a structural anchor. We conclude that PLMs implicitly encode the causal hierarchy of allosteric transmission through a query-anchor topology, establishing directed attention as a robust indicator of long-range functional coordination.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Correlations from structure and phylogeny combine constructively in the inference of protein partners from sequences 94%
- Gene regulatory network structure informs the distribution of perturbation effects 94%
- Characterizing and inferring epistasis via direct evolutionary couplings in models of allostery 94%
Similar papers in this journal
Similar papers in this journal
- Epistasis facilitates functional evolution in an ancient transcription factor 95%
- Deep mutational scanning and machine learning reveal structural and molecular rules governing allosteric hotspots in homologous proteins 94%
- Allosteric mechanism of signal transduction in the two-component system histidine kinase PhoQ 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.