图 书 馆
可靠众包系统的迭代学习Iterative Learning for Reliable Crowdsourcing Systems |
|
| 课程网址: | http://videolectures.net/nips2011_oh_crowdsourcing/ |
| 主讲教师: | Sewoong Oh |
| 开课单位: | 伊利诺伊大学 |
| 开课时间: | 2012-01-25 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Crowdsourcing systems, in which tasks are electronically distributed to numerous "information piece-workers", have emerged as an effective paradigm for human-powered solving of large scale problems in domains such as image classification, data entry, optical character recognition, recommendation, and proofreading. Because these low-paid workers can be unreliable, nearly all crowdsourcers must devise schemes to increase confidence in their answers, typically by assigning each task multiple times and combining the answers in some way such as majority voting. In this paper, we consider a general model of such crowdsourcing tasks, and pose the problem of minimizing the total price (i.e., number of task assignments) that must be paid to achieve a target overall reliability. We give new algorithms for deciding which tasks to assign to which workers and for inferring correct answers from the workers’ answers. We show that our algorithm significantly outperforms majority voting and, in fact, are asymptotically optimal through comparison to an oracle that knows the reliability of every worker. |
| 关 键 词: | 众包系统; 电子方式; 图像分类 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2020-07-13：yumf |
| 阅读次数: | 53 |