Longevity Bench: Are SotA LLMs ready for aging research?
Zhavoronkov, A.; Sidorenko, D.; Naumov, V.; Pushkov, S.; Zagirova, D.; Aladinskiy, V.; Aliper, A.; Galkin, F.
Show abstract
Aging is a core biological process observed in most species and tissues, which is studied with a vast array of technologies. We argue that the abilities of AI systems to emulate aging and to accurately interpret biodata in its context are the key criteria to judge an LLMs utility in biomedical research. Here, we present LongevityBench -- a collection of tasks designed to assess whether foundation models grasp the fundamental principles of aging biology and can use low-level biodata to arrive at phenotype-level conclusions. The benchmark covers a variety of prediction targets including human time-to-death, mutations effect on lifespan, and age-dependent omics patterns. It spans all common biodata types used in longevity research: transcriptomes, DNA methylation profiles, proteomes, genomes, clinical blood tests and biometrics, as well as natural language annotations. After ranking state-of-the-art foundation models using LongevityBench, we highlight their weaknesses and outline procedures to maximize their utility in aging research and life sciences.
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- A New Sparse Bayesian Quantile Neural Network-based Approach and Its Application to Discover Physiological Sweet Spots in the Canadian Longitudinal Study on Aging 96%
- A novel approach of human geroprotector discovery by targeting the converging subnetworks of aging and age-related diseases 95%
- DNA methylation clocks struggle to distinguish inflammaging from healthy aging, but feature rectification improves coherence and enhances detection of inflammaging 95%
Similar papers in this journal
- Development of a novel transcriptomic measure of aging: Transcriptomic Mortality-risk Age (TraMA) 94%
- Healthspan pathway maps in C. elegans and humans highlight transcription, prolifera-tion/biosynthesis and lipids 94%
- AI-Driven Toolset for IPF and Aging Research Associates Lung Fibrosis with Accelerated Aging 94%
Similar papers in this journal
Similar papers in this journal
- ORANGE: A Machine Learning Approach for Modeling Tissue-Specific Aging from Transcriptomic Data 96%
- Age-specific gene signatures underlying the transcriptomes and functional connectomes of human cerebral cortex 89%
- Explainable deep neural networks for predicting sample phenotypes from single-cell transcriptomics 89%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.