0


顺序蒙特卡罗方法

Sequential Monte-Carlo Methods
课程网址: http://videolectures.net/nips09_doucet_freitas_smc/  
主讲教师: Nando de Freitas, Arnaud Doucet
开课单位: 牛津大学
开课时间: 2010-01-19
课程语种: 英语
中文简介:
在过去的十五年中,顺序蒙特卡罗(SMC)方法作为解决顺序数据建模中出现的难以处理的推理问题的有力工具而受到欢迎。为了估计动态模型中潜在变量的滤波分布,已经投入了大量精力来开发SMC方法,称为粒子滤波器(PFs)。这一系列研究产生了许多算法,包括辅助变量PF,边际PF,重采样移动算法和Rao Blackwellised PF。它还在跟踪,计算机视觉,机器人和计量经济学方面引领了许多应用。在此期间,这些方法的理论性质也得到了广泛的研究。尽管PF占据了中心位置,但在开发用于参数估计,在线EM,粒子平滑和用于控制和规划的SMC技术的SMC方法方面也取得了重大进展。还设计了各种SMC算法来近似非标准化函数的序列,从而允许计算大矩阵和核算子的特征对。最近,提出了使用SMC方法为MCMC构建高效的高维度提议分布的框架。这使我们能够在标准策略失败的复杂场景中设计有效的MCMC算法。这些方法已经在许多领域得到证明,包括模拟回火,Dirichlet过程混合,非线性非高斯状态空间模型,蛋白质折叠和随机微分方程。最后,还推广了SMC方法以在静态模型中进行近似推断。这通常通过构建概率分布序列来完成,该序列以易于从分布中取样并且收敛到期望的目标分布开始。这些SMC方法已成功应用于众所周知的硬问题,如玻尔兹曼机器的推理,边际参数估计和非线性贝叶斯实验设计。在本教程中,我们将介绍经典的SMC方法,并向观众介绍该领域的新发展。
课程简介: Over the last fifteen years, sequential Monte Carlo (SMC) methods gained popularity as powerful tools for solving intractable inference problems arising in the modelling of sequential data. Much effort was devoted to the development of SMC methods, known as particle filters (PFs), for estimating the filtering distribution of the latent variables in dynamic models. This line of research produced many algorithms, including auxiliary-variable PFs, marginal PFs, the resample-move algorithm and Rao-Blackwellised PFs. It also led to many applications in tracking, computer vision, robotics and econometrics. The theoretical properties of these methods were also studied extensively in this period. Although PFs occupied the center-stage, significant progress was also attained in the development of SMC methods for parameter estimation, online EM, particle smoothing and SMC techniques for control and planning. Various SMC algorithms were also designed to approximate sequences of unnormalized functions, thus allowing for the computation of eigen-pairs of large matrices and kernel operators. Recently, frameworks for building efficient high-dimensional proposal distributions for MCMC using SMC methods were proposed. These allow us to design effective MCMC algorithms in complex scenarios where standard strategies failed. Such methods have been demonstrated on a number of domains, including simulated tempering, Dirichlet process mixtures, nonlinear non-Gaussian state-space models, protein folding and stochastic differential equations. Finally, SMC methods were also generalized to carry out approximate inference in static models. This is typically done by constructing a sequence of probability distributions, which starts with an easy-to-sample-from distribution and which converges to the desired target distribution. These SMC methods have been successfully applied to notoriously hard problems, such as inference in Boltzmann machines, marginal parameter estimation and nonlinear Bayesian experimental design. In this tutorial, we will introduce the classical SMC methods and expose the audience to the new developments in the field.
关 键 词: 顺序数据; 粒子滤波器; 动态模型
课程来源: 视频讲座网
最后编审: 2019-07-24:cwx
阅读次数: 141