0


模式分类和大边距分类器

Pattern Classification and Large Margin Classifiers
课程网址: http://videolectures.net/mlss06tw_bartlett_pclmc/  
主讲教师: Peter L. Bartlett
开课单位: 加州大学伯克利分校
开课时间: 2007-02-25
课程语种: 英语
中文简介:
这些讲座将介绍模式分类方法的理论。他们将关注学习系统的极小极大性能与其复杂性之间的关系。将有四个讲座。第一部分将回顾模式分类问题的制定,以及几种流行的模式分类方法,并以Rademacher平均值表示一般风险界限,衡量一类函数的复杂性。第二讲将在minimax设置中考虑模式分类,并表明,在此设置中,Vapnik-Chervonenkis维度是复杂性的关键度量。第三讲将集中讨论计算复杂性的主题。它将呈现类的复杂性(通过其VC维度测量)与类中函数的计算复杂性之间的优雅关系。本讲座还将回顾关于模式分类问题的计算复杂性的一般结果,以及它与相关经验风险优化问题的紧密关系。第四讲将考虑大边际分类方法,如AdaBoost,支持向量机和神经网络,将它们视为难处理的经验最小化问题的凸松弛。它将回顾这些大边际方法的几个统计特性,特别是导致精确分类器的凸优化问题的表征,以及这些方法和概率模型之间的关系。
课程简介: These lectures will provide an introduction to the theory of pattern classification methods. They will focus on relationships between the minimax performance of a learning system and its complexity. There will be four lectures. The first will review the formulation of the pattern classification problem, and several popular pattern classification methods, and present general risk bounds in terms of Rademacher averages, a measure of the complexity of a class of functions. The second lecture will consider pattern classification in a minimax setting, and show that, in this setting, the Vapnik-Chervonenkis dimension is the key measure of complexity. The third lecture will focus on a theme of computational complexity. It will present the elegant relationship between the complexity of a class, as measured by its VC-dimension, and the computational complexity of functions from the class. This lecture will also review general results on the computational complexity of the pattern classification problem, and its tight relationship with that of an associated empirical risk optimization problems. The fourth lecture will consider large margin classification methods, such as AdaBoost, support vector machines, and neural networks, viewing them as convex relaxations of intractable empirical minimization problems. It will review several statistical properties of these large margin methods, in particular, a characterization of the convex optimization problems that lead to accurate classifiers, and relationships between these methods and probability models.
关 键 词: 模式分类方法; 关键度量; 凸优化问题
课程来源: 视频讲座网
最后编审: 2019-07-16:cjy
阅读次数: 75