Web搜索引擎的批量查询处理Batch Query Processing for Web Search Engines |
|
课程网址: | http://videolectures.net/wsdm2011_ding_pvs/ |
主讲教师: | Shuai Ding |
开课单位: | 纽约大学理工学院 |
开课时间: | 信息不详。欢迎您在右侧留言补充。 |
课程语种: | 英语 |
中文简介: | 大型网络搜索引擎现在每天处理数十亿次查询。大多数查询本质上是交互式的,需要几分之一秒的响应。但是,也有许多重要的场景,在这些场景中,为各种不需要立即响应的web挖掘和系统优化任务提交了大量查询。考虑到在数十亿个web页面上执行搜索查询的巨大成本,询问这批查询是否能比交互式查询更有效是一个很自然的问题。在本文中,我们激励和讨论了搜索引擎中的批量查询处理问题,确定了提高此类查询性能的基本机制,并对所提出的技术进行了初步的实验评估。我们的结论是,通过使用专门的机制在Web搜索引擎中执行批处理查询,可以显著降低成本。 |
课程简介: | Large web search engines are now processing billions of queries per day. Most of these queries are interactive in nature, requiring a response in fractions of a second. However, there are also a number of important scenarios where large batches of queries are submitted for various web mining and system optimization tasks that do not require an immediate response. Given the significant cost of executing search queries over billions of web pages, it is a natural question to ask if such batches of queries can be more efficiently executed than interactive queries. In this paper, we motivate and discuss the problem of batch query processing in search engines, identify basic mechanisms for improving the performance of such queries, and provide a preliminary experimental evaluation of the proposed techniques. Our conclusion is that significant cost reductions are possible by using specialized mechanisms for executing batch queries in Web search engines. |
关 键 词: | 计算机科学; 网页搜索; 批量查询 |
课程来源: | 视频讲座网 |
最后编审: | 2019-10-29:cwx |
阅读次数: | 44 |