0


一种有效融合套索问题的高效算法

An Efficient Algorithm for a Class of Fused Lasso Problems
课程网址: http://videolectures.net/kdd2010_liu_eacf/  
主讲教师: Jun Liu
开课单位: 亚利桑那州立大学
开课时间: 2010-10-01
课程语种: 英语
中文简介:
融合的套索惩罚在系数和它们的连续差异上都加强了稀疏性,这对于以某种有意义的方式排列特征的应用是可取的。然而,由此产生的问题是很难解决的,因为融合的套索惩罚既不光滑也不可分离。现有算法计算复杂度高,不适用于大规模问题。本文提出了一种有效的融合拉索算法(EFLA)来优化这类问题。提出的EFLA中的一个关键组成部分是融合激光信号近似器(FLSA)。为了有效地解决FLSA问题,我们建议将其重新表述为在最小值处找到融合惩罚的“适当”子梯度问题,并开发出一种子梯度查找算法(SFA)。我们进一步设计了一种重启技术,利用原问题和重构的FLSA问题的特殊“结构”,加速了SFA的收敛。我们的经验评估表明,SFA和EFLA都显著优于现有的求解器。我们还演示了熔融套索的几种应用。
课程简介: The fused Lasso penalty enforces sparsity in both the coefficients and their successive differences, which is desirable for applications with features ordered in some meaningful way. The resulting problem is, however, challenging to solve, as the fused Lasso penalty is both non-smooth and non-separable. Existing algorithms have high computational complexity and do not scale to large-size problems. In this paper, we propose an Efficient Fused Lasso Algorithm (EFLA) for optimizing this class of problems. One key building block in the proposed EFLA is the Fused Lasso Signal Approximator (FLSA). To efficiently solve FLSA, we propose to reformulate it as the problem of finding an ``appropriate" subgradient of the fused penalty at the minimizer, and develop a Subgradient Finding Algorithm (SFA). We further design a restart technique to accelerate the convergence of SFA, by exploiting the special ``structures" of both the original and the reformulated FLSA problems. Our empirical evaluations show that, both SFA and EFLA significantly outperform existing solvers. We also demonstrate several applications of the fused Lasso.
关 键 词: 融合套索算法; 线性分析; 重启技术
课程来源: 视频讲座网
最后编审: 2019-12-27:lxf
阅读次数: 48