首页代数学
0


秩最小化通过在线学习

Rank Minimization via Online Learning
课程网址: http://videolectures.net/icml08_meka_rmv/  
主讲教师: Raghu Meka
开课单位: 阿姆斯特丹大学
开课时间: 2008-08-04
课程语种: 英语
中文简介:
最小等级问题在机器学习应用中经常出现,并且由于等级目标的非凸性质而众所周知地难以解决。在本文中,我们提出了第一个在多面体集上矩阵秩最小化问题的在线学习方法。特别地,我们提出了两种用于秩最小化的在线学习算法 - 我们的第一种算法是基于广义专家框架的乘法更新方法,而我们的第二种算法是在线凸规划框架的新应用[Zinkevich,2003]。在后者中,我们通过使决策者搜索约束空间而不是可行点来颠倒决策者的角色,这在在线凸规划中通常就是这种情况。我们的在线学习方法的一个显着特点是它允许我们为多面体集上的秩最小化问题提供第一个可证明的近似保证。我们证明了我们的方法在合成示例上的有效性,以及低阶内核学习的实际应用。
课程简介: Minimum rank problems arise frequently in machine learning applications and are notoriously difficult to solve due to the non-convex nature of the rank objective. In this paper, we present the first online learning approach for the problem of rank minimization of matrices over polyhedral sets. In particular, we present two online learning algorithms for rank minimization - our first algorithm is a multiplicative update method based on a generalized experts framework, while our second algorithm is a novel application of the online convex programming framework [Zinkevich, 2003]. In the latter, we flip the role of the decision maker by making the decision maker search over the constraint space instead of feasible points, as is usually the case in online convex programming. A salient feature of our online learning approach is that it allows us to give the first provable approximation guarantees for the rank minimization problem over polyhedral sets. We demonstrate the effectiveness of our methods on synthetic examples, and on the real-life application of low-rank kernel learning.
关 键 词: 在线学习矩阵; 在线凸规划框架; 秩最小化问题
课程来源: 视频讲座网
最后编审: 2020-05-21:王淑红(课程编辑志愿者)
阅读次数: 99