图 书 馆
从人工噪声中识别数据的无监督学习Unsupervised Learning by Discriminating Data from Artificial Noise |
|
| 课程网址: | http://videolectures.net/nipsworkshops09_gutmann_ulddan/ |
| 主讲教师: | Michael Gutmann |
| 开课单位: | 国赫尔辛基科技机构 |
| 开课时间: | 2010-03-26 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Noise-contrastive estimation is a new estimation principle that we have developed for parameterized statistical models. The idea is to train a classifier to discriminate between the observed data and some artificially generated noise, using the model log-density function in a logistic regression function. It can be proven that this leads to a consistent (convergent) estimator of the parameters. The method is shown to directly work for models where the density function does not integrate to unity (unnormalized models). The normalization constant (partition function) can be estimated like any other parameter. We compare the method with other methods that can be used to estimate unnormalized models, including score matching, contrastive divergence, and maximum-likelihood where the correct normalization is estimated with importance sampling. Simulations show that noise-contrastive estimation offers the best trade-off between computational and statistical efficiency. The method is then applied to the modeling of natural images. |
| 关 键 词: | 无监督学习; 建模; 统计 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2020-06-29：wuyq |
| 阅读次数: | 48 |