A way around the exploration-exploitation dilemma
Peterson, E. J.; Verstynen, T. V.
Show abstract
Balancing exploration with exploitation is seen as a mathematically intractable dilemma that all animals face. In this paper, we provide an alternative view of this classic problem that does not depend on exploring to optimize for reward. We argue that the goal of exploration should be pure curiosity, or learning for learnings sake. Through theory and simulations we prove that explore-exploit problems based on this can be solved by a simple rule that yields optimal solutions: when information is more valuable than rewards, be curious, otherwise seek rewards. We show that this rule performs well and robustly under naturalistic constraints. We suggest three criteria can be used to distinguish our approach from other theories.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Predicting phenotype transition probabilities via conditional algorithmic probability approximations 96%
- Modularity of biological systems: a link between structure and function 96%
- Efficient Manipulation and Generation of Kirchhoff Polynomials for the Analysis of Non-equilibrium Biochemical Reaction Networks 96%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.