Back

Phenotypes of ultra-rare variant carriers benchmark variant effect scores

Londhe, S.; Holtkamp, E.; Tsitsiridis, G.; Starovoit, A.; Tomaz da Silva, P.; Hingerl, J.; Finucane, H.; Gagneur, J.

2026-10-02 genomics
10.64898/2026.10.01.755962 bioRxiv
Show abstract

Human genetics needs benchmarks for evaluating variant scores against observed phenotypic consequences. We therefore present UKBBGym, which evaluates coding and non-coding scores against plasma protein abundance and quantitative traits observed in carriers of ultra-rare variants in the UK Biobank. This design avoids ascertainment biases of clinical labels, potential physiological mismatch of experimental assays, and confounding pertaining to common-variant associations. UKBBGym recapitulates relative performance on pathogenicity prediction while enabling comparison across variant classes and molecular mechanisms. This shows that scores designed for coding and splicing variants correlate more strongly with protein abundance and quantitative traits than scores modelling transcriptional regulation. Moreover, experimental assays do not consistently outperform computational scores for predicting missense effects. Comparing captured to detectable variance indicates scope for improvement, particularly for indels and loss-of-function variants. Finally, for coding variants, UKBBGym can be reproduced from public summary statistics, providing an accessible population-phenotype benchmark complementary to clinical labels and experimental assays.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.