多巴胺2型受体控制从知觉推理到强化学习的反向温度βDopamine type 2 receptors control inverse temperature beta for transition from perceptual inference to reinforcement learning |
|
课程网址: | http://videolectures.net/rldm2015_lee_reinforcement_learning/ |
主讲教师: | Eunjeong Lee |
开课单位: | 国家精神卫生研究所 |
开课时间: | 2015-07-28 |
课程语种: | 英语 |
中文简介: | 决策基于即时感知和以往经验的结合。如果一个环境中的行动和结果之间的映射随着时间的推移是不可预测的,那么必须根据即时可用的信息做出决策。或者,如果可以通过强化学习行动结果映射,则可以将此信息与立即可用的信息结合起来。先前的神经生理学结果表明,额叶纹状体回路可能参与这些过程之间的相互作用。然而,多巴胺的作用还没有被直接检测。我们将多巴胺1型(D1A;SCH23390)或多巴胺2型(D2A;艾克洛普)拮抗剂或生理盐水局部注射到背侧纹状体,同时猕猴执行动眼神经顺序决策任务。任务中的选择是由知觉推理和/或对过去选择的强化驱动的。我们发现D2A影响了基于先前结果的决策。当我们拟合Rescorla-Wagner模型时,与注射前相比,D2A注射到背侧纹状体后反向温度降低。我们发现D1A和生理盐水注射都不会影响行为。总的来说,我们的结果表明纹状体中的D2R控制强化学习中的反向温度。 |
课程简介: | Decisions are based on a combination of immediate perception and previous experience. If the mapping between actions and outcomes in a context is unpredictable over time, decisions must be made on the basis of immediately available information. Alternatively, if action-outcome mappings can be learned by reinforcement, then this information can be combined with immediately available information. Previous neurophysiological results suggest that frontal-striatal circuits may be involved in the interaction between these processes. The role of dopamine, however, has not been examined directly. We injected locally dopamine type 1 (D1A; SCH23390) or type 2 (D2A; Eticlopride) antagonists or saline into the dorsal striatum while macaques performed an oculomotor sequential decision making task. Choices in the task were driven by perceptual inference and/or reinforcement of past choices. We found that the D2A affected decisions based on previous outcomes. When we fit Rescorla-Wagner models, the inverse temperature decreased after D2A injections into the dorsal striatum compared with a pre-injection period. We found that neither the D1A nor saline injections affected behavior. Overall, our results suggest D2Rs in the striatum control the inverse temperature in reinforcement learning. |
关 键 词: | 强化学习; 多巴胺; 反向温度 |
课程来源: | 视频讲座网 |
数据采集: | 2021-11-28:zkj |
最后编审: | 2021-11-28:zkj |
阅读次数: | 82 |