图 书 馆
稀疏，高维概率的压缩神经表示Compressive neural representation of sparse, high-dimensional probabilities |
|
| 课程网址: | http://videolectures.net/machine_pitkow_neural/ |
| 主讲教师: | Xaq Pitkow |
| 开课单位: | 罗彻斯特大学 |
| 开课时间: | 2013-01-14 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | This paper shows how sparse, high-dimensional probability distributions could be represented by neurons with exponential compression. The representation is a novel application of compressive sensing to sparse probability distributions rather than to the usual sparse signals. The compressive measurements correspond to expected values of nonlinear functions of the probabilistically distributed variables. When these expected values are estimated by sampling, the quality of the compressed representation is limited only by the quality of sampling. Since the compression preserves the geometric structure of the space of sparse probability distributions, probabilistic computation can be performed in the compressed domain. Interestingly, functions satisfying the requirements of compressive sensing can be implemented as simple perceptrons. If we use perceptrons as a simple model of feedforward computation by neurons, these results show that the mean activity of a relatively small number of neurons can accurately represent a high-dimensional joint distribution implicitly, even without accounting for any noise correlations. This comprises a novel hypothesis for how neurons could encode probabilities in the brain. |
| 关 键 词: | 指数压缩; 高维概率分布; 稀疏概率分布 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2019-05-15：lxf |
| 阅读次数: | 82 |