0


在非负最大堆上的投影

Projection onto A Nonnegative Max-Heap
课程网址: http://videolectures.net/nips2011_ye_maxheap/  
主讲教师: Jieping Ye
开课单位: 密歇根大学
开课时间: 2012-09-06
课程语种: 英语
中文简介:
我们考虑计算长度为$ p $的向量的欧几里得投影到非负最大堆上的有序树的问题,其中节点的值都是非负的,并且任何父节点的值都不小于该值(s) )其子节点。此Euclidean投影在优化问题中扮演构建块角色,具有非负最大堆约束。当特征遵循有序树结构时,这种约束是合乎需要的,即,仅当选择了其父节点时,才为给定的回归/分类任务选择给定特征。在本文中,我们表明这种欧几里德投影问题允许一个解析解,我们开发一个自顶向下算法,其中关键操作是找到以每个节点为根的子树的所谓\ emph {最大根树}。查找最大根树的一种简单方法是枚举所有可能的根树,然而这些根树不能很好地扩展。我们揭示了最大根树的几个重要属性,在此基础上我们设计了一个带有合并的自下而上算法,以便有效地找到最大根树。所提出的算法对于顺序列表具有(最差情况)线性时间复杂度,并且对于一般树具有$ O(p ^ 2)$。我们报告模拟结果,显示具有有序树结构的回归的最大堆的有效性。实证结果表明,该算法对于许多特殊情况具有预期的线性时间复杂度,包括顺序列表,完整二叉树和深度为1的树。
课程简介: We consider the problem of computing the Euclidean projection of a vector of length $p$ onto a non-negative max-heap - an ordered tree where the values of the nodes are all nonnegative and the value of any parent node is no less than the value(s) of its child node(s). This Euclidean projection plays a building block role in the optimization problem with a non-negative max-heap constraint. Such a constraint is desirable when the features follow an ordered tree structure, that is, a given feature is selected for the given regression/classification task only if its parent node is selected. In this paper, we show that such Euclidean projection problem admits an analytical solution and we develop a top-down algorithm where the key operation is to find the so-called \emph{maximal root-tree} of the subtree rooted at each node. A naive approach for finding the maximal root-tree is to enumerate all the possible root-trees, which, however, does not scale well. We reveal several important properties of the maximal root-tree, based on which we design a bottom-up algorithm with merge for efficiently finding the maximal root-tree. The proposed algorithm has a (worst-case) linear time complexity for a sequential list, and $O(p^2)$ for a general tree. We report simulation results showing the effectiveness of the max-heap for regression with an ordered tree structure. Empirical results show that the proposed algorithm has an expected linear time complexity for many special cases including a sequential list, a full binary tree, and a tree with depth 1.
关 键 词: 欧几里得投影; 非负最大堆; 顺序列表
课程来源: 视频讲座网
最后编审: 2019-09-06:lxf
阅读次数: 51