图 书 馆
有界噪声下线性分离器的高效学习Efficient Learning of Linear Separators under Bounded Noise |
|
| 课程网址: | https://videolectures.net/videos/colt2015_urner_linear_separators |
| 主讲教师: | Ruth Urner |
| 开课单位: | 信息不详。欢迎您在右侧留言补充。 |
| 开课时间: | 2025-02-04 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | We study the learnability of linear separators in $\Re^d$ in the presence of bounded (a.k.a Massart) noise. This is a realistic generalization of the random classification noise model, where the adversary can flip each example $x$ with probability $\eta(x) \leq \eta$. We provide the first polynomial time algorithm that can learn linear separators to arbitrary small excess error in this noise model under the uniform distribution over the unit sphere in $\Re^d$. While widely studied in the statistical learning theory community in the context of getting faster convergence rates, computationally efficient algorithms in this model had remained elusive. Our work provides the first evidence that one can indeed design algorithms achieving arbitrary small excess errors in polynomial time under this realistic noise model and thus opens up a new and exciting line of research. We additionally provide lower bounds showing that popular algorithms such as hinge loss minimization and averaging cannot lead to arbitrary small excess error under Massart noise, even under the uniform distribution. Our work instead, makes use of a margin based technique developed in the context of active learning. As a result, our algorithm is also an active learning algorithm with only a logarithmic dependence in the desired excess error $\epsilon$. |
| 关 键 词: | 线性分离器：随即分类噪声模型; 统计学 |
| 课程来源: | 视频讲座网 |
| 数据采集: | 2025-04-02：zsp |
| 最后编审: | 2025-04-02：zsp |
| 阅读次数: | 1 |