0


多任务套索的分块协调下降法及其在神经语义基发现中的应用

Blockwise Coordinate Descent Procedures for the Multi-Task Lasso with Applications to Neural Semantic Basis Discovery
课程网址: http://videolectures.net/icml09_palatucci_bcdp/  
主讲教师: Mark Palatucci
开课单位: 卡内基梅隆大学
开课时间: 2009-08-26
课程语种: 英语
中文简介:
我们为多任务Lasso开发了一种循环的块状坐标下降算法,可有效地解决数千个特征和任务的问题。主要结果表明,可以获得一个封闭形式的Winsorization算子用于支持最小二乘回归。这使得算法能够比现有方法更有效地找到非常大规模问题的解决方案。这一结果补充了弗里德曼等人的开创性工作。 (2007年)为单一任务Lasso。作为案例研究,我们使用多任务Lasso作为变量选择器来发现预测人类神经激活的语义基础。对于大多数测试参与者而言,学习的解决方案优于此任务的标准基础,同时对认知神经科学的假设要少得多。我们展示了这种学习基础如何能够洞察大脑如何表达单词的意义。
课程简介: We develop a cyclical blockwise coordinate descent algorithm for the multi-task Lasso that efficiently solves problems with thousands of features and tasks. The main result shows that a closed-form Winsorization operator can be obtained for the sup-norm penalized least squares regression. This allows the algorithm to find solutions to very large-scale problems far more efficiently than existing methods. This result complements the pioneering work of Friedman, et al. (2007) for the single-task Lasso. As a case study, we use the multi-task Lasso as a variable selector to discover a semantic basis for predicting human neural activation. The learned solution outperforms the standard basis for this task on the majority of test participants, while requiring far fewer assumptions about cognitive neuroscience. We demonstrate how this learned basis can yield insights into how the brain represents the meanings of words.
关 键 词: 下降算法; 最小二乘回归; 标准基础
课程来源: 视频讲座网
最后编审: 2019-04-24:cwx
阅读次数: 22