图 书 馆
强化学习和贝叶斯学习简介Introduction to Reinforcement Learning and Bayesian learning |
|
| 课程网址: | http://videolectures.net/icml07_ghavamzadeh_itrl/ |
| 主讲教师: | Mohammad Ghavamzadeh |
| 开课单位: | 阿尔伯塔大学 |
| 开课时间: | 2007-06-22 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Although Bayesian methods for Reinforcement Learning can be traced back to the 1960s (Howard's work in Operations Research), Bayesian methods have only been used sporadically in modern Reinforcement Learning. This is in part because non-Bayesian approaches tend to be much simpler to work with. However, recent advances have shown that Bayesian approaches do not need to be as complex as initially thought and offer several theoretical advantages. For instance, by keeping track of full distributions (instead of point estimates) over the unknowns, Bayesian approaches permit a more comprehensive quantification of the uncertainty regarding the transition probabilities, the rewards, the value function parameters and the policy parameters. Such distributional information can be used to optimize (in a principled way) the classic exploration/exploitation tradeoff, which can speed up the learning process. Similarly, active learning for reinforcement learning can be naturally optimized. The estimation of gradient performance with respect to value function or and/or policy parameters can also be done more accurately while using less data. Bayesian approaches also facilitate the encoding of prior knowledge and the explicit formulation of domain assumptions. The primary goal of this tutorial is to raise the awareness of the research community with regard to Bayesian methods, their properties and potential benefits for the advancement of Reinforcement Learning. An introduction to Bayesian learning will be given, followed by a historical account of Bayesian Reinforcement Learning and a description of existing Bayesian methods for Reinforcement Learning. The properties and benefits of Bayesian techniques for Reinforcement Learning will be discussed, analyzed and illustrated with case studies. |
| 关 键 词: | 贝叶斯强化学习方法; 跟踪未知数; 转移概率 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2019-04-17：lxf |
| 阅读次数: | 162 |