0


一组用于构造稀疏性的惩罚函数

A Family of Penalty Functions for Structured Sparsity
课程网址: http://videolectures.net/nips2010_morales_fpf/  
主讲教师: Jean Morales
开课单位: 伦敦大学学院
开课时间: 2011-03-25
课程语种: 英语
中文简介:
我们研究了在其稀疏模式结构的附加条件下学习稀疏线性回归向量的问题。我们提出了一系列凸罚函数,它们通过对回归系数的绝对值的一组约束来编码该先验知识。这个家族包含$ \ ell_1 $规范,并且足够灵活,可以包含不同的稀疏模式模型,这些模型具有实际和理论上的重要性。我们建立了这些函数的一些重要属性,并讨论了可以明确计算它们的一些示例。此外,我们提出了一种收敛优化算法,用于求解具有这些罚函数的正则化最小二乘。数值模拟突出了结构化稀疏性的好处以及我们的方法优于Lasso和其他相关方法所提供的优势。
课程简介: We study the problem of learning a sparse linear regression vector under additional conditions on the structure of its sparsity pattern. We present a family of convex penalty functions, which encode this prior knowledge by means of a set of constraints on the absolute values of the regression coefficients. This family subsumes the $\ell_1$ norm and is flexible enough to include different models of sparsity patterns, which are of practical and theoretical importance. We establish some important properties of these functions and discuss some examples where they can be computed explicitly. Moreover, we present a convergent optimization algorithm for solving regularized least squares with these penalty functions. Numerical simulations highlight the benefit of structured sparsity and the advantage offered by our approach over the Lasso and other related methods.
关 键 词: 稀疏模式; 稀疏线性; 凸罚函数
课程来源: 视频讲座网
最后编审: 2019-09-06:lxf
阅读次数: 81