Back

Gradient-based implementation of linear model outperforms deep learning models

Hamidi, H.; Wang, D.; Long, Q.; Greenberg, M.

2023-07-29 bioinformatics
10.1101/2023.07.29.551062 bioRxiv
Show abstract

Deep learning has been widely considered more effective than traditional statistical models in modeling biological complex data such as single-cell omics. Here we show the devil is hidden in details: by adapting a modern gradient solver to a traditional linear mixed model, we showed that conventional models can outperform deep models in terms of both speed and accuracy. This work reveals the potential of re-implementing traditional models with modern solvers.

Matching journals

The top 3 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.