0


具有特异性约束的在线分类

Online Classification with Specificity Constraints
课程网址: http://videolectures.net/nips2010_bernstein_ocs/  
主讲教师: Andrey Bernstein
开课单位: 以色列理工学院
开课时间: 2011-03-25
课程语种: 英语
中文简介:
我们考虑了在线二值分类问题,给出了m个分类器。在每个阶段,分类器将输入映射到输入属于正类的概率。在线分类元算法是一种结合分类器输出以达到一定目标的算法,它不需要预先知道输入的形式和统计信息,也不需要预先知道给定分类器的性能。本文采用灵敏度和特异性作为元算法的性能指标。特别是,我们的目标是设计一种满足以下两个性质(渐近性)的算法:(i)其平均假阳性率(fp率)在某一给定阈值下;(i i)其平均真阳性率(tp率)不低于满足fp大鼠的m给定分类器的最佳凸组合的tp率。事后看来,限制。我们证明了这个问题实际上是一个带约束的遗憾最小化问题的特例,因此上述目标是不可实现的。为此,我们提出了一个宽松的目标,并提出了相应的实用在线学习元算法。在两个分类器的情况下,我们证明了该算法的形式非常简单。据我们所知,这是第一个解决在线设置中平均fp速率约束下平均tp速率最大化问题的算法。
课程简介: We consider the online binary classification problem, where we are given m classifiers. At each stage, the classifiers map the input to the probability that the input belongs to the positive class. An online classification meta-algorithm is an algorithm that combines the outputs of the classifiers in order to attain a certain goal, without having prior knowledge on the form and statistics of the input, and without prior knowledge on the performance of the given classifiers. In this paper, we use sensitivity and specificity as the performance metrics of the meta-algorithm. In particular, our goal is to design an algorithm which satisfies the following two properties (asymptotically): (i) its average false positive rate (fp-rate) is under some given threshold, and (ii) its average true positive rate (tp-rate) is not worse than the tp-rate of the best convex combination of the m given classifiers that satisfies fp-rate constraint, in hindsight. We show that this problem is in fact a special case of the regret minimization problem with constraints, and therefore the above goal is not attainable. Hence, we pose a relaxed goal and propose a corresponding practical online learning meta-algorithm that attains it. In the case oftwo classifiers, we show that this algorithm takes a very simple form. To our best knowledge, this is the first algorithm that addresses the problem of the average tp-rate maximization under average fp-rate constraints in the online setting.
关 键 词: 计算机科学; 机器学习; 在线学习
课程来源: 视频讲座网
最后编审: 2020-05-29:吴雨秋(课程编辑志愿者)
阅读次数: 43