压力和基因型对强化学习中勘探开发动态的影响Effects of Stress and Genotype on Exploration-Exploitation Dynamics in Reinforcement Learning |
|
课程网址: | http://videolectures.net/otee06_luksys_esgee/ |
主讲教师: | Gedi Lukšys |
开课单位: | 洛桑联邦理工学院 |
开课时间: | 2007-02-25 |
课程语种: | 英语 |
中文简介: | 压力和遗传背景通过压力激素和神经调节剂的作用调节行为学习的不同方面。同样,在强化学习(RL)模型中,开发探索因子和其他元参数控制学习动态和性能。我们发现,使用元参数的动态控制,简单的RL模型可以复制许多不同的动物学习和表现度量。为了研究应激和基因型的影响,我们对2个不同基因株的小鼠进行了5孔盒光照和Morris水迷宫实验,将它们暴露在不同的应激源下。然后,我们使用RL模型来模拟它们的行为。对于每一个实验环节,我们估计了一组模型元参数,这些参数在模型和动物性能之间产生了最佳匹配。两个模拟试验的勘探开发因子具有相似的特征动力学,不同的遗传菌株和应力条件有显著差异。 |
课程简介: | Stress and genetic background regulate different aspects of behavioral learning through the action of stress hormones and neuromodulators. Similarly, in reinforcement learning (RL) models, exploitation-exploration factor and other meta-parameters control learning dynamics and performance. We found that many different measures of animal learning and performance can be reproduced by simple RL models using dynamic control of the meta-parameters. To study the effects of stress and genotype, we carried out 5-hole-box light conditioning and Morris water maze experiments with 2 different genetic strains of mice, exposing them to different stressors. Then, we used RL models to simulate their behavior. For each experimental session, we estimated a set of model meta-parameters that produced the best fit between the model and the animal performance. Exploration-exploitation factors had similar characteristic dynamics for the two simulated experiments, and there were statistically significant differences between different genetic strains and stress conditions. |
关 键 词: | 应激激素; 神经调节; 强化学习; 勘探开发因素; 统计学 |
课程来源: | 视频讲座网 |
最后编审: | 2020-06-02:毛岱琦(课程编辑志愿者) |
阅读次数: | 84 |