In changing environments, adaptive decision-making requires balancing when to choose familiar, known options with when to explore new, unknown options. This balancing act, known as the explore-exploit tradeoff, is critical to how we make choices that can maximize reward. Specifically, exploration supports optimal decision-making by reducing the uncertainty associated with previously unknown choices.