0


用高斯混合模型估计EM算法的局部最优值

Estimating Local Optimums in EM Algorithm over Gaussian Mixture Model
课程网址: http://videolectures.net/icml08_zhang_elo/  
主讲教师: Zhenjie Zhang
开课单位: 新加坡国立大学
开课时间: 2008-08-05
课程语种: 英语
中文简介:
EM算法是从大型观测集估计高斯混合模型参数的一种非常流行的方法。但是,在大多数情况下,EM算法无法保证收敛到全局最优。相反,它停在一些局部优化,这可能比全局最优更糟糕。因此,通常需要运行具有不同初始配置的EM算法的多个过程并返回最佳解决方案。为了提高该方案的效率,我们提出了一种新方法,该方法可以基于最新EM迭代之后的当前配置来估计局部最优的对数似然的上界。这是通过首先导出限制局部最优的可能位置的一些区域,然后对最大似然进行一些上限估计来实现的。通过这种估计,如果估计的局部最优值肯定比目前看到的最佳解决方案更差,我们可以终止EM算法程序。大量实验表明,我们的方法可以有效地加速传统的EM算法。
课程简介: EM algorithm is a very popular method to estimate the parameters of Gaussian Mixture Model from a large observation set. However, in most cases, EM algorithm is not guaranteed to converge to the global optimum. Instead, it stops at some local optimums, which can be much worse than the global optimum. Therefore, it is usually required to run multiple procedures of EM algorithm with different initial configurations and return the best solution. To improve the efficiency of this scheme, we propose a new method which can estimate an upper bound on the logarithm likelihood of the local optimum, based on the current configuration after the latest EM iteration. This is accomplished by first deriving some region bounding the possible locations of local optimum, followed by some upper bound estimation on the maximum likelihood. With this estimation, we can terminate an EM algorithm procedure if the estimated local optimum is definitely worse than the best solution seen so far. Extensive experiments show that our method can effectively and efficiently accelerate conventional EM algorithm.
关 键 词: 高斯混合模型; 对数似然; 局部最优
课程来源: 视频讲座网
最后编审: 2019-04-21:lxf
阅读次数: 71