Optimal distance metrics for single-cell RNA-seq populations
Ji, Y.; Green, T.; Peidli, S.; Bahrami, M.; Liu, M.; Zappia, L.; Hrovatin, K.; Sander, C.; Theis, F.
Show abstract
In single-cell data workflows and modeling, distance metrics are commonly used in loss functions, model evaluation, and subpopulation analysis. However, these metrics behave differently depending on the source of variation, conditions and subpopulations in single-cell expression profiles due to data sparsity and high dimensionality. Thus, the metrics used for downstream tasks in this domain should be carefully selected. We establish a set of benchmarks with three evaluation measures, capturing desirable facets of absolute and relative distance behavior. Based on seven datasets using perturbation as ground truth, we evaluated 16 distance metrics applied to scRNA-seq data and demonstrated their application to three use cases. We find that linear metrics such as mean squared error (MSE) performed best across our three evaluation criteria. Therefore, we recommend the use of MSE for comparing single-cell RNA-seq populations and evaluating gene expression prediction models.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- scBFA: modeling detection patterns to mitigate technical noise in large-scale single cell genomics data 97%
- A Systematic Evaluation of Single-cell RNA-sequencing Imputation Methods 96%
- Modelling asymmetric count ratios in CRISPR screens to decrease experiment size and improve phenotype detection 96%
Similar papers in this journal
- A versatile information retrieval framework for evaluating profile strength and similarity 97%
- Triple-effect correction for Cell Painting data with contrastive and domain-adversarial learning 95%
- GRouNdGAN: GRN-guided simulation of single-cell RNA-seq data using causal generative adversarial networks 95%
Similar papers in this journal
- FIRM: Flexible Integration of single-cell RNA-sequencing data for large-scale Multi-tissue cell atlas datasets 95%
- Supervised Application of Internal Validation Measures to Benchmark Dimensionality Reduction Methods in scRNA-seq Data 94%
- Accurate and fast cell marker gene identification with COSG 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.