0


在灵长类动物脑中的代表价值

Representation of Value in the Primate Brain
课程网址: http://videolectures.net/mitworld_glimcher_rvpb/  
主讲教师: Paul W. Glimcher
开课单位: 纽约大学
开课时间: 2010-08-09
课程语种: 英语
中文简介:
鸽子真的很像小米种子,猴子渴望果汁,人类可以获得奖金。虽然所有的动物都没有获得相同的奖励,但保罗·格里姆彻发现了动物大脑学会识别和追求有价值的方式的一些共同特征。格里姆彻是神经经济学年轻领域的创始人之一,其中经济学理论帮助调查大脑功能。因此,他的方法包括博弈论以及测量单个神经元的发射并不奇怪。 Glimcher的讲话详细介绍了他过去15年的研究,他将其描述为试图通过研讨会发言人Okihide Hikosaka对基础神经节电路进行经典研究“添加一些东西”。根据Hikosaka的数据和其他研究,Glimcher开始相信黑质(基底神经节的一部分)的神经元正在为动物编写一些有价值的东西,但这些神经元“不是回应奖励本身,而是回应偏差“例如,如果一只鸽子期望在有条件的线索之后传送小米种子,没有神经元被射击,但如果奖励被延迟,然后突然传递,那么鸽子会发现它的初始预测错误,并且其神经元爆发为了捕捉这些神经元,主要由神经递质多巴胺激活,使动物能够调整预期和预测奖励的方式,出现了各种各样的模型。但是Glimcher发现了其他科学家的“条件参数”的错误。他说,“作为经济学家,这是令人沮丧的。”因此,他开发了三个数学公理来测试所谓的奖励预测误差(RPE)模型。他的工作“提出了一种统一数据的方法”,认为基底神经节从多巴胺神经元和进入的刺激物中以定量的方式学习“行动的价值。”Glimcher假设多巴胺神经元具有价值。奖励刚收到,“并从之前奖励的加权指数平均值中减去,如果没有不匹配,就不应该激发......多巴胺神经元。”基于赌博,果汁和种子奖励的人类,猴子和鸽子研究,分别巩固了他的观点,即多巴胺神经元是RPE编码系统的一部分,它们传达了预期的奖励和收到的奖励之间的差异。这使得Glimcher相信“基底神经节的一个主要功能是学习我们行动的价值,代表它们,并抽出数据来产生选择。”
课程简介: Pigeons really like millet seed, monkeys crave juice, and humans get a kick out of winning money. While all animals don’t enjoy the same rewards, Paul Glimcher has discovered some common features in the way animal brains learn to recognize and pursue something of value. Glimcher is one of the founding fathers of the young field of neuroeconomics, in which economic theories help inform investigations of brain function. It’s not surprising then, that his approaches include game theory as well as measuring the firing of single neurons. Glimcher’s talk details his research from the past 15 years, what he describes as an attempt to “add something” to the classic studies on the basal ganglia circuit conducted by fellow symposium speaker Okihide Hikosaka. From Hikosaka’s data and other research, Glimcher came to believe that neurons of the substantia nigra (part of the basal ganglia) were coding for something of worth to an animal, but that these neurons were “responding not to reward per se, but to deviations to expectation.” For instance, if a pigeon expected a delivery of millet seed following a conditioned cue, no neurons fired, but if the reward was delayed, then suddenly delivered, the pigeon would find its initial prediction in error, and its neurons burst into action. Various models emerged to capture the ways in which these neurons, energized primarily by the neurotransmitter dopamine, enabled animals to adjust expectations about and predict rewards. But Glimcher found fault with others scientists’ “conditional parameters.” He says, “As an economist, this is frustrating.” So he developed three mathematical axioms for testing the so-called Reward Prediction Error (RPE) models. His work “suggested a way of unifying the data,” with the notion that the basal ganglia learns “the values of actions in a quantitative way … from the dopamine neurons and the incoming stimulus.” Glimcher hypothesized that dopamine neurons take the value of a reward just received, “and subtract it from a weighted exponential average of previous rewards, and if there’s no mismatch, there should be no firing of…dopamine neurons.” Human, monkey and pigeon studies -- based on gambling, juice, and seed rewards, respectively -- solidified his notion that dopamine neurons are part of an RPE encoding system where they convey the differences between rewards expected and rewards received. This has led Glimcher to believe that “one of the principle functions of the basal ganglia is to learn the values of our actions, represent them, and pump out the data to produce choice.”
关 键 词: 动物大脑; 经济学; 神经元
课程来源: 视频讲座网
最后编审: 2019-05-29:lxf
阅读次数: 43