0


LSTD的随机预测

LSTD with Random Projections
课程网址: http://videolectures.net/nips2010_ghavamzadeh_lstd/  
主讲教师: Mohammad Ghavamzadeh
开课单位: INRIA研究机构
开课时间: 2011-03-25
课程语种: 英语
中文简介:
研究了特征数大于样本数时高维空间中的强化学习问题。特别地,我们研究了由高维空间随机投影生成低维空间时的最小二乘时差(LSTD)学习算法。我们对随机投影的LSTD进行了深入的理论分析,并给出了算法的性能界限。我们还展示了随机投影LSTD的误差是如何通过策略迭代算法的迭代传播的,并为由此产生的最小二乘策略迭代(LSPI)算法提供了性能界限。
课程简介: We consider the problem of reinforcement learning in high-dimensional spaces when the number of features is bigger than the number of samples. In particular, we study the least-squares temporal difference (LSTD) learning algorithm when a space of low dimension is generated with a random projection from a high-dimensional space. We provide a thorough theoretical analysis of the LSTD with random projections and derive performance bounds for the resulting algorithm. We also show how the error of LSTD with random projections is propagated through the iterations of a policy iteration algorithm and provide a performance bound for the resulting least-squares policy iteration (LSPI) algorithm.
关 键 词: 高维空间; 理论分析; 策略迭代算法
课程来源: 视频讲座网
最后编审: 2020-07-29:yumf
阅读次数: 44