图 书 馆
单一和多个指数模型Single and Multiple Index Models |
|
| 课程网址: | http://videolectures.net/nipsworkshops2012_ravikumar_single/ |
| 主讲教师: | Pradeep Ravikumar |
| 开课单位: | 德克萨斯大学 |
| 开课时间: | 2013-01-16 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Statistical estimation in the high-dimensional setting, with more variables than samples, has been the focus of considerable research over the last decade. It is now well understood that consistent estimation is still possible under such high-dimensional settings provided we impose suitable constraints on the model space. These structural constraints are however typically easier to impose when the statistical model has a finite-dimensional parametric form. A natural approach to extend these to the non-parametric setting is to work with semi-parametric models, and impose these structural constraints on the parametric component of the semi-parametric model. In this talk, we consider the semi-parametric model class of single and multiple index models. Here, the regression function is assumed to be a sum of univariate functions of linear projections of the data. We show that we can combine "classical nonparametrics" (projection pursuit regression and backfitting) with a "variational principle" based on convex optimization to address the difficult optimization problems arising in estimating such models. In particular, we show that the standard maximum-likelihood based approach is non-convex and brittle, but we can use Bregman divergences to derive a computationally tractable backfitting procedure. We demonstrate the utility of this modeling approach in a retinal modeling application. |
| 关 键 词: | 高维设置; 统计模型; 三维参数; 半参数模型; 指数模型 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2020-06-06：zyk |
| 阅读次数: | 61 |