The Sweet Lesson of Neuroscience

In the early years of modern deep learning, the brain served as a guiding model. Concepts such as hippocampal replay, which involves the brain rehearsing past experiences, provided frameworks for how agents could learn from memories. Additionally, research on temporal-difference learning indicated that responses from some dopamine neurons in the brain closely resemble reward-prediction errors.