图 书 馆
DistLODStats:RDF数据集统计的分布式计算DistLODStats: Distributed Computation of RDF Dataset Statistics |
|
| 课程网址: | http://videolectures.net/iswc2018_sejdiu_distlodstats_distributed... |
| 主讲教师: | Gezim Sejdiu |
| 开课单位: | 波恩大学计算机科学研究所 |
| 开课时间: | 2018-11-22 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Over the last years, the Semantic Web has been growing steadily. Today, we count more than 10,000 datasets made available online following Semantic Web standards. Nevertheless, many applications, such as data integration, search, and interlinking, may not take the full advantage of the data without having a priori statistical information about its internal structure and coverage. In fact, there are already a number of tools, which offer such statistics, providing basic information about RDF datasets and vocabularies. However, those usually show severe deficiencies in terms of performance once the dataset size grows beyond the capabilities of a single machine. In this paper, we introduce a software library for statistical calculations of large RDF datasets, which scales out to clusters of machines. More specifically, we describe the first distributed in-memory approach for computing 32 different statistical criteria for RDF datasets using Apache Spark. The preliminary results show that our distributed approach improves upon a previous centralized approach we compare against and provides approximately linear horizontal scale-up. The criteria are extensible beyond the 32 default criteria, is integrated into the larger SANSA framework and employed in at least four major usage scenarios beyond the SANSA community. |
| 关 键 词: | 语义Web标准; 大型RDF数据集; 不同统计标准的分布式内存方法; SANSA框架 |
| 课程来源: | 视频讲座网 |
| 数据采集: | 2022-12-23：cyh |
| 最后编审: | 2023-05-15：cyh |
| 阅读次数: | 9 |