0


从记录的隐式勘探数据中学习

Learning from Logged Implicit Exploration Data
课程网址: http://videolectures.net/nips2010_strehl_lli/  
主讲教师: Alexander Strehl
开课单位: 脸书公司
开课时间: 2011-03-25
课程语种: 英语
中文简介:
我们为在“上下文强盗”或“部分标记”设置中使用非随机探索数据提供了合理且一致的基础,其中仅学习所选动作的值。各种环境中的主要挑战是未明确知道记录“离线”数据的勘探政策。此处的现有解决方案要求在学习过程期间控制动作,记录随机探索,或者以重复方式不经意地选择动作。这里报告的技术解除了这些限制,允许学习一个策略,用于从未发生随机化或记录的历史数据中选择给定特征的动作。我们根据互联网%在线广告公司从两个合理大小的真实世界数据中验证我们的解决方案。
课程简介: We provide a sound and consistent foundation for the use of nonrandom exploration data in "contextual bandit" or "partially labeled" settings where only the value of a chosen action is learned. The primary challenge in a variety of settings is that the exploration policy, in which "offline" data is logged, is not explicitly known. Prior solutions here require either control of the actions during the learning process, recorded random exploration, or actions chosen obliviously in a repeated manner. The techniques reported here lift these restrictions, allowing the learning of a policy for choosing actions given features from historical data where no randomization occurred or was logged. We empirically verify our solution on two reasonably sized sets of real-world data obtained from an Internet %online advertising company.
关 键 词: 部分标记; 探索数据; 广告公司
课程来源: 视频讲座网
最后编审: 2020-01-13:chenxin
阅读次数: 81