图 书 馆
使用浅文本特征的样板检测Boilerplate Detection Using Shallow Text Features |
|
| 课程网址: | http://videolectures.net/wsdm2010_kohlschutter_bdu/ |
| 主讲教师: | Christian Kohlschütter |
| 开课单位: | 汉诺威莱布尼兹大学 |
| 开课时间: | 2010-10-07 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | In addition to the actual content Web pages consist of navigational elements, templates, and advertisements. This boilerplate text typically is not related to the main content, may deteriorate search precision and thus needs to be detected properly. In this paper, we analyze a small set of shallow text features for classifying the individual text elements in a Web page. We compare the approach to complex, state- of-the-art techniques and show that competitive accuracy can be achieved, at almost no cost. Moreover, we derive a simple and plausible stochastic model for describing the boilerplate creation process. With the help of our model, we also quantify the impact of boilerplate removal to retrieval performance and show significant improvements over the baseline. Finally, we extend the principled approach by straight-forward heuristics, achieving a remarkable accuracy. |
| 关 键 词: | 计算机科学; 挖掘; 搜索精度 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2020-06-01：heyf |
| 阅读次数: | 65 |