图 书 馆
使用点击数据检测重复的网络文档Detecting Duplicate Web Documents using Clickthrough Data |
|
| 课程网址: | http://videolectures.net/wsdm2011_radlinski_duc/ |
| 主讲教师: | Filip Radlinski |
| 开课单位: | 微软公司 |
| 开课时间: | 2011-08-09 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | The web contains many duplicate and near-duplicate documents. Given that user satisfaction is negatively affected by redundant information in search results, a significant amount of research has been devoted to developing duplicate detection algorithms. However, most such algorithms rely solely on document content to detect duplication, ignoring the fact that a primary goal of duplicate detection is to identify documents that contain redundant information with respect to a particular user query. Similarly, although query-dependent result diversification algorithms compute a query-dependent ranking, they tend to do so on the basis of a query-independent content similarity score. In this paper, we bridge the gap between query-dependent redundancy and query-independent duplication by showing how user click behavior following a query provides evidence about the relative novelty of web documents. While most previous work on interpreting user clicks on search results has assumed that they reflect just result relevance, we show that clicks also provide information about duplication between web documents since users consider search results in the context of previously seen documents. Moreover, we find that duplication explains a substantial amount of presentation bias observed in clicking behavior. We identify three distinct types of redundancy that commonly occur on the web and show how click data can be used to detect these different types. |
| 关 键 词: | 文档; 检测算法; 计算机科学 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2020-04-13：chenxin |
| 阅读次数: | 20 |