본문 바로가기 주메뉴 바로가기 하위메뉴 바로가기

Institute for Basic Science

Home Contact us Join Login

CENTER for GENOME ENGINEERING

  • About Center
    • Introduction
    • Organization
    • Location
    • Contact Us
    • Center CI
  • People
    • Co-Director
    • Associate Director
    • Faculty
    • Young Scientist Fellow
    • Research Fellow
    • Researcher
    • Student
    • People Search
    • Staff
    • Collaborating Faculty
    • Undergraduate students
  • Research
    • Neuro Technology Group
    • Congnitive Computational Neuroscience
    • 7T Human Connectome Project
    • Research Core
  • Publication
    • Research Highlights
    • Journals
    • Presentation
    • Proceedings
    • Patents
    • Books
  • Facilities
    • Equipment
    • Form & Info
  • Events
    • Seminar Series
    • Seminar
    • Summer School Program
    • Conference
    • Calendar
  • News
    • News
    • Videos
    • Gallery
    • Brochure
전체메뉴
Home Events Seminar Print Page

Events

  • Seminar Series
  • Seminar
  • Summer School Program
    • Summer School 2025
    • Summer School 2024
    • Summer School 2023
    • Summer School 2022
    • Summer School 2019
    • Summer School 2018
    • Summer School 2017
    • Summer School 2016
  • Conference
  • Calendar

Seminar

A derivative-like prediction error computation by dopamine neurons in a dynamic environment

김형구

October 1(Tue) - October 1(Tue), 2019

16:00 - 17:00

# 86314

CNIR Seminar


Date: 04:00 pm Tuesday, October 1st

 
Place: #86314

Speaker: 김형구, Ph.D.

Harvard University, Naoshige Uchida's Lab

 

 

Title: "A derivative-like prediction error computation by dopamine neurons in a dynamic environment" 

Abstract: Previous studies have revealed an exceptional correspondence between the activity of midbrain dopamine neurons and a ‘teaching signal’ in reinforcement learning algorithms. In particular, the reward prediction error (RPE) used in the temporal difference (TD) learning algorithm captures aspects of phasic dopamine responses. However, this idea has been challenged by recent observations that dopamine signals ramp up gradually over the timescale of seconds as animals approach a reward location. It has been argued that these slow fluctuations of dopamine are inconsistent with the RPE model, and instead represent the state value, which gradually increases toward a reward location. Whether these slowly fluctuating dopamine signals represent value or RPE, and under what conditions a dopamine ramp occurs, remain elusive. As originally formulated, the TD RPE approximates the derivative of the value function. Here we developed a set of novel experimental paradigms that dissociate RPE from value. We employed visual virtual reality in mice to manipulate the location of the animal and the speed of scene movement independent of the animal’s locomotion. We found that the manipulation of scene movement – teleport and speed manipulations – caused dopamine responses in the ventral striatum that were consistent with TD RPEs but inconsistent with state values. Furthermore, we found that a more abstract, non-navigational stimulus that indicates temporal proximity to reward is sufficient to cause a dopamine ramp. These results support the previously untested central tenet of TD RPEs that dopamine neurons signal RPEs through a derivative-like computation over value on a momentby-moment basis. 

 

Host: Prof. Joonyeol Lee

 

LIST

CENTER FOR NEUROSCIENCE IMAGING RESEARCH

IBS Center for Neuroscience Imaging Research, N Center, Sungkyunkwan University, Seobu-ro 2066, Jangan-gu, Suwon, Korea Tel.+82-31-299-4354 / Fax.+82-31-299-4506

Copyright(c) 2022 IBS Center For Neuroscience Imaging Research. All Rights Reserved.