Back

A hyperparameter-randomized ensemble approach for robust clustering across diverse datasets

Goggin, S.; Zunder, E.

2023-12-19 bioinformatics
10.1101/2023.12.18.571953 bioRxiv
Show abstract

Clustering analysis is widely used to group objects by similarity, but for complex datasets such as those produced by single-cell analysis, the currently available clustering methods are limited by accuracy, robustness, ease of use, and interpretability. To address these limitations, we developed an ensemble clustering method with hyperparameter randomization that outperforms other methods across a broad range of single-cell and synthetic datasets, without the need for manual hyperparameter selection. In addition to hard cluster labels, it also outputs soft cluster memberships to characterize continuum-like regions and per cell overlap scores to quantify the uncertainty in cluster assignment. We demonstrate the improved clustering interpretability from these features by tracing the intermediate stages between handwritten digits in the MNIST dataset, and between tanycyte subpopulations in the hypothalamus. This approach improves the quality of clustering and subsequent downstream analyses for single-cell datasets, and may also prove useful in other fields of data analysis.

Matching journals

The top 2 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.