Back

Rigorous (in)validation of ecological models

Song, C.; Levine, J. M.

2024-09-23 ecology
10.1101/2024.09.19.613075 bioRxiv
Show abstract

The complexity of ecosystems poses a formidable challenge for confidently invalidating ecological models, as current practices struggle to distinguish model inadequacies from the confounding effects of unobserved biotic or abiotic factors. The prevailing inability to falsify models has resulted in an accumulation of models but not an accumulation of confidence. Here, we introduce a new approach rooted in queueing theory, termed the covariance criteria, that establishes a rigorous test for model validity based on covariance relationships between observable quantities. These criteria set a high bar for models to pass by specifying necessary conditions that must hold regardless of unobserved factors. We demonstrate the broad applicability and discriminatory power of the covariance criteria by applying them to three long-standing challenges in ecological theory: resolving competing models of predator-prey functional responses, disentangling ecological and evolutionary dynamics in systems with rapid evolution, and detecting the often-elusive influence of higher-order species interactions. Across these diverse case studies, the covariance criteria consistently rule out inadequate models, while building strong confidence in those that provide strategically useful approximations. The covariance criteria approach is mathematically rigorous, computationally efficient, and often non-parametric, making it immediately applicable to existing data and models.

Matching journals

The top 5 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.