Back

A synthetic peptide library for benchmarking crosslinking mass spectrometry search engines

Beveridge, R.; Stadlmann, J.; Penninger, J. M.; Mechtler, K.

2019-10-28 bioinformatics
10.1101/821447 bioRxiv
Show abstract

We have created synthetic peptide libraries to benchmark crosslinking mass spectrometry search engines for different types of crosslinker. The unique benefit of using a library is knowing which identified crosslinks are true and which are false. Here we have used mass spectrometry data generated from measurement of the peptide libraries to evaluate the most frequently applied search algorithms in crosslinking mass-spectrometry. When filtered to an estimated false discovery rate of 5%, false crosslink identification ranged from 5.2% to 11.3% for search engines with inbuilt validation strategies for error estimation. When different external validation strategies were applied to one single search output, false crosslink identification ranged from 2.4% to a surprising 32%, despite being filtered to an estimated 5% false discovery rate. Remarkably, the use of MS-cleavable crosslinkers did not reduce the false discovery rate compared to non-cleavable crosslinkers, results from which have far-reaching implications in structural biology. We anticipate that the datasets acquired during this research will further drive optimisation and development of search engines and novel data-interpretation technologies, thereby advancing our understanding of vital biological interactions.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

1
Journal of the American Society for Mass Spectrometry
33 papers in training set
Top 0.1%
18.2%
2
Journal of Proteome Research
215 papers in training set
Top 0.3%
13.0%
3
Molecular & Cellular Proteomics
158 papers in training set
Top 0.4%
6.7%
4
Nature Communications
4913 papers in training set
Top 30%
6.2%
5
PLOS ONE
4510 papers in training set
Top 29%
6.2%
50% of probability mass above
6
PLOS Computational Biology
1633 papers in training set
Top 6%
6.2%
7
Structure
175 papers in training set
Top 1%
3.0%
8
Analytical Chemistry
205 papers in training set
Top 1.0%
2.8%
9
Biophysical Journal
545 papers in training set
Top 2%
2.0%
10
Computational and Structural Biotechnology Journal
216 papers in training set
Top 4%
1.7%
11
PROTEOMICS
35 papers in training set
Top 0.4%
1.7%
12
Nature Methods
336 papers in training set
Top 4%
1.6%
13
Communications Chemistry
39 papers in training set
Top 0.3%
1.6%
14
Protein Science
221 papers in training set
Top 1.0%
1.6%
15
Chemical Science
71 papers in training set
Top 1%
1.3%
16
Cell Systems
167 papers in training set
Top 9%
1.3%
17
Journal of Molecular and Cellular Cardiology
39 papers in training set
Top 0.6%
1.2%
18
Journal of Chemical Information and Modeling
207 papers in training set
Top 2%
1.2%
19
Bioinformatics
1061 papers in training set
Top 9%
0.8%
20
GigaScience
172 papers in training set
Top 3%
0.7%
21
Molecules
37 papers in training set
Top 2%
0.7%
22
Journal of Structural Biology
58 papers in training set
Top 2%
0.7%
23
Frontiers in Molecular Biosciences
100 papers in training set
Top 6%
0.7%
24
Scientific Reports
3102 papers in training set
Top 77%
0.7%
25
eLife
5422 papers in training set
Top 60%
0.7%
26
Nucleic Acids Research
1128 papers in training set
Top 19%
0.7%
27
Journal of Molecular Biology
217 papers in training set
Top 4%
0.6%
28
Communications Biology
886 papers in training set
Top 30%
0.6%