Personal tools
You are here: Home Events ANC/DTC Seminar: Peter Dayan, Gatsby Computational Neuroscience Unit (Host: Peggy Series)

ANC/DTC Seminar: Peter Dayan, Gatsby Computational Neuroscience Unit (Host: Peggy Series)

— filed under:

Interactions between Model-free and Model-based Reinforcement Learning

What
  • ANC/DTC Seminar
When Apr 03, 2012
from 11:00 AM to 12:00 PM
Where IF 4.31/4.33
Add event to calendar vCal
iCal

Substantial recent work has explored multiple mechanisms of decision-making in humans and other animals. Functionally and anatomically distinct modules have been identified, and their individual properties have been examined using intricate behavioural and neural tools. I will discuss the background of these studies, and show fMRI results that suggest closer and more complex interactions between the mechanisms than originally conceived. In some circumstances, model-free methods seize control after much less experience than would seem normative; in others, temporal difference prediction errors, which are epiphenomenal for the model-based system, are nevertheless present and apparently effective. Finally, I will show that model-free and model-based methods on occasion both cower in the face of Pavlovian influences, and will try and reconcile this as a form of robust control.