Aird: A computation-oriented mass spectrometry data format enables higher compression ratio and less decoding time
Lu, M.; An, S.; Wang, R.; Wang, J.; Yu, C.
Show abstract
With the precision of mass spectrometer going higher and the emergence of data independence acquisition (DIA), the file size is increasing rapidly. Beyond the widely-used open format mzML (Deutsch 2008), near-lossless or lossless compression algorithms and formats have emerged. The data precision is often related to the instrument and subsequent processing algorithms. Unlike storage-oriented formats, which focusing more on lossless compression and compression rate, computation-oriented formats focus as much on decoding speed and disk read strategy as compression rate. Here we describe "Aird", an opensource and computation-oriented format with controllable precision, flexible indexing strategies and high compression rate. Aird uses JavaScript Object Notation (JSON) for metadata storage, multiple indexing, and reordered storage strategies for higher speed of data randomly reading. Aird also provides a novel compressor called Zlib-Diff-PforDelta (ZDPD) for m/z data compression. Compared with Zlib only, m/z data size is about 65% lower in Aird, and merely takes 33% decoding time. AvailabilityAird SDK is written in Java, which allow scholars to access mass spectrometry data efficiently. It is available at https://github.com/Propro-Studio/Aird-SDK AirdPro can convert vendor files into Aird files, which is available at https://github.com/Propro-Studio/AirdPro
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Alpha-XIC: a deep neural network for scoring the coelution of peak groups improves peptide identification by data-independent acquisition mass spectrometry 97%
- massDatabase: utilities for the operation of the public compound and pathway database 96%
- TDFragMapper: a visualization tool for evaluating experimental parameters in top-down proteomics 95%
Similar papers in this journal
Similar papers in this journal
- pDeep3: Towards More Accurate Spectrum Prediction with Fast Few-Shot Learning 96%
- mzrtsim: Raw Data Simulation for Reproducible Gas/Liquid Chromatography Mass Spectrometry Based Non-targeted Metabolomics Data Analysis 96%
- spectrum_utils: A Python package for mass spectrometry data processing and visualization 95%
Similar papers in this journal
- Moiety Modeling Framework for Deriving Moiety Abundances from Mass Spectrometry Measured Isotopologues 94%
- Fast alignment of mass spectra in large proteomics datasets, capturing dissimilarities arising from multiple complex modifications of peptides 93%
- MassComp, a lossless compressor for mass spectrometry data 92%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.