PCKS:语义流处理系统基准测试规则PCKS: Commandments for Benchmarking Semantic Flow Processing Systems |
|
课程网址: | http://videolectures.net/eswc2013_fetahu_entity_linking/ |
主讲教师: | Thomas Scharrenbach |
开课单位: | 苏黎世大学 |
开课时间: | 2013-11-15 |
课程语种: | 英语 |
中文简介: | PCKS是一种系统地对语义流处理系统进行基准测试的新颖方法。在确定语义流处理系统和手头数据集的特性和挑战的基础上,我们阐述了定义适当的关键绩效指标的重要性。在ESWC 2013上发表的相应论文中,我们研究了PCKS下当前基准测试的性能。我们发现它们最大的缺点是它们限制输入吞吐量作为唯一的关键性能指标。表明语义流处理系统必须在其他关键性能指标(如正确性)下进行评估。在我们的研究中,我们指出了如何将当前的基准扩展到系统地对语义流处理引擎进行压力测试。 PCKS将帮助您更多地了解各种评估标准下的性能。 p> |
课程简介: | PCKS is a novel approach for systematically benchmarking semantic flow processing systems. Based on identifying the properties and challenges of a semantic flow processing system and data set at hand, we elaborate the importance of defining appropriate key performance indicators. In the corresponding paper published at ESWC 2013 we investigate how current benchmarks perform under PCKS. We find that their most significant shortcoming is their restriction to input throughput as the sole key performance indicator. Showing that semantic flow processing systems must be evaluated under other key performance indicators such as correctness. In our study we indicate how extend current benchmarks to systematically stress-test semantic flow processing engines. PCKS will help learning more about their performance under various evaluation criteria. |
关 键 词: | 语义流处理系统; PCKS; 限制输入吞吐量 |
课程来源: | 视频讲座网 |
数据采集: | 2021-05-28:zyk |
最后编审: | 2021-05-28:zyk |
阅读次数: | 63 |