Back

Benchmarking 80 binary phenotypes from the openSNP dataset using deep learning algorithms and polygenic risk score tools

Muneeb, M. -; Ascher, D.; Myung, Y.; Feng, S.; Henschel, A.

2026-03-09 bioinformatics
10.64898/2026.03.06.710126 bioRxiv
Show abstract

Genotype-phenotype prediction plays a crucial role in identifying disease-causing single nucleotide polymorphisms and precision medicine. In this manuscript, we benchmark the performance of various machine/deep learning algorithms and polygenic risk score tools on 80 binary phenotypes extracted from the openSNP dataset. After cleaning and extraction, the genotype data for each phenotype is passed to PLINK for quality control, after which it is transformed separately for each of the considered tools/algorithms. To compute polygenic risk scores, we used the quality control measures for the test data and the genome-wide association studies summary statistic file, along with various combinations of clumping and pruning. For the machine learning algorithms, we used p-value thresholding on the training data to select the single nucleotide polymorphisms, and the resulting data was passed to the algorithm. Our results report the average 5-fold Area Under the Curve (AUC) for 29 machine learning algorithms, 80 deep learning algorithms, and 3 polygenic risk scores tools with 675 different clumping and pruning parameters. Machine learning outperformed for 44 phenotypes, while polygenic risk score tools excelled for 36 phenotypes. The results give us valuable insights into which techniques tend to perform better for certain phenotypes compared to more traditional polygenic risk scores tools.

Matching journals

The top 10 journals account for 50% of the predicted probability mass.

1
Briefings in Bioinformatics
326 papers in training set
Top 0.4%
10.0%
2
Genome Medicine
154 papers in training set
Top 1%
6.3%
3
BMC Medical Genomics
36 papers in training set
Top 0.1%
6.3%
4
Bioinformatics
1061 papers in training set
Top 4%
4.8%
5
Scientific Reports
3102 papers in training set
Top 28%
4.3%
6
BioData Mining
15 papers in training set
Top 0.1%
4.3%
7
Nature Communications
4913 papers in training set
Top 36%
4.1%
8
Genomics, Proteomics & Bioinformatics
171 papers in training set
Top 2%
3.5%
9
Nucleic Acids Research
1128 papers in training set
Top 6%
3.5%
10
Database
51 papers in training set
Top 0.2%
3.5%
50% of probability mass above
11
Frontiers in Genetics
197 papers in training set
Top 2%
3.5%
12
PLOS Computational Biology
1633 papers in training set
Top 11%
3.0%
13
PLOS ONE
4510 papers in training set
Top 45%
2.6%
14
The American Journal of Human Genetics
206 papers in training set
Top 2%
2.6%
15
Human Genetics
25 papers in training set
Top 0.1%
1.8%
16
PLOS Genetics
756 papers in training set
Top 8%
1.8%
17
BMC Bioinformatics
383 papers in training set
Top 5%
1.7%
18
International Journal of Molecular Sciences
453 papers in training set
Top 8%
1.7%
19
Journal of Genetics and Genomics
36 papers in training set
Top 1%
1.5%
20
Computational and Structural Biotechnology Journal
216 papers in training set
Top 6%
1.3%
21
NAR Genomics and Bioinformatics
214 papers in training set
Top 2%
1.3%
22
Nature Machine Intelligence
61 papers in training set
Top 3%
1.2%
23
Communications Biology
886 papers in training set
Top 15%
1.2%
24
GigaScience
172 papers in training set
Top 2%
0.9%
25
Patterns
70 papers in training set
Top 2%
0.9%
26
Genome Biology
555 papers in training set
Top 6%
0.9%
27
IEEE/ACM Transactions on Computational Biology and Bioinformatics
32 papers in training set
Top 0.5%
0.9%
28
European Journal of Human Genetics
49 papers in training set
Top 1%
0.9%
29
BMC Genomics
328 papers in training set
Top 5%
0.8%
30
Journal of Biomedical Informatics
45 papers in training set
Top 1%
0.8%