图 书 馆
学习连续动作控制策略的二元动作搜索Binary Action Search for Learning Continuous-Action Control Policies |
|
| 课程网址: | http://videolectures.net/icml09_pazis_bas/ |
| 主讲教师: | Jason Pazis |
| 开课单位: | 克里特理工大学 |
| 开课时间: | 2009-08-26 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Reinforcement Learning methods for controlling stochastic processes typically assume a small and discrete action space. While continuous action spaces are quite common in real-world problems, the most common approach still employed in practice is coarse discretization of the action space. This paper presents a novel method, called Binary Action Search, for realizing continuous-action policies by searching efficiently the entire action range through increment and decrement modifications to the values of the action variables according to an internal binary policy defined over an augmented state space. The proposed approach essentially approximates any continuous action space to arbitrary resolution and can be combined with any discrete-action reinforcement learning algorithm for learning continuous-action policies. Binary Action Search eliminates the restrictive modification steps of Adaptive Action Modification and requires no temporal action locality in the domain. Our approach is coupled with two well-known reinforcement learning algorithms (Least-Squares Policy Iteration and Fitted Q-Iteration) and its use and properties are thoroughly investigated and demonstrated on the continuous state-action Inverted Pendulum, Double Integrator, and Car on the Hill domains. |
| 关 键 词: | 随机过程; 离散化; 最小二乘策略迭代 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2021-04-09：yumf |
| 阅读次数: | 40 |