图 书 馆
加强人类和其他动物的学习Reinforcement Learning in Humans and Other Animals |
|
| 课程网址: | http://videolectures.net/nips2010_daw_rlh/ |
| 主讲教师: | Nathaniel Daw |
| 开课单位: | 纽约大学 |
| 开课时间: | 2011-01-12 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Algorithms from computer science can serve as detailed process-level hypotheses for how the brain might approach difficult information processing problems. This tutorial reviews how ideas from the computational study of reinforcement learning have been used in biology to conceptualize the brain's mechanisms for trial-and-error decision making, drawing on evidence from neuroscience, psychology, and behavioral economics. We begin with the much-debated relationship between temporal-difference learning and the neuromodulator dopamine, and then consider how more sophisticated methods and concepts from RL -- including partial observability, hierarchical RL, function approximation, and various model-based approaches -- can provide frameworks for understanding additional issues in the biology of adaptive behavior. In addition to helping to organize and conceptualize data from many different levels, computational models can be employed more quantitatively in the analysis of experimental data. The second aim of this tutorial is to review and demonstrate, again using the example of reinforcement learning, recent methodological advances in analyzing experimental data using computational models. An RL algorithm can be viewed as generative model for raw, trial-by-trial experimental data such as a subject's choices or a dopaminergic neuron's spiking responses; the problems of estimating model parameters or comparing candidate models then reduce to familiar problems in Bayesian inference. Viewed this way, the analysis of neuroscientific data is ripe for the application of many of the same sorts of inferential and machine learning techniques well studied by the NIPS community in other problem domains. |
| 关 键 词: | 计算机科学; 强化学习; 神经调节 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2019-07-25：cwx |
| 阅读次数: | 56 |