Back

BinBencher: Fast, flexible and meaningful benchmarking suite for metagenomic binning

Nissen, J. N.; Lindez, P. P.; Rasmussen, S.

2024-05-08 bioinformatics
10.1101/2024.05.06.592671 bioRxiv
Show abstract

New methods for metagenomic binning are typically evaluated using benchmarking software, and become tuned to maximize whatever criterion is measured by the benchmark. Subtleties in benchmarking procedures can cause misleading evaluations, derailing method development. Differences between procedures used to evaluate binning tools make them hard to compare, which slows progress in the field. We introduce BinBencher, a free software suite for benchmarking, and show how BinBencher produces evaluations that are more biologically meaningful than alternative benchmarking approaches.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.