利用维基百科作为文档聚类的外部知识Exploiting Wikipedia as External Knowledge for Document Clustering |
|
课程网址: | http://videolectures.net/kdd09_hu_ewaek/ |
主讲教师: | Xiaohua Tony Hu |
开课单位: | 德雷塞尔大学 |
开课时间: | 信息不详。欢迎您在右侧留言补充。 |
课程语种: | 英语 |
中文简介: | 52002:SYSTEM ERROR |
课程简介: | In traditional text clustering methods, documents are represented as bags of words without considering the semantic information of each document. For instance, if two documents use different collections of core words to represent the same topic, they may be falsely assigned to different clusters due to the lack of shared core words, although the core words they use are probably synonyms or semantically associated in other forms. The most common way to solve this problem is to enrich document representation with the background knowledge in an ontology. There are two major issues for this approach: (1) the coverage of the ontology is limited, even for WordNet or Mesh, (2) using ontology terms as replacement or additional features may cause information loss, or introduce noise. In this paper, we present a novel text clustering method to address these two issues by enriching document representation with Wikipedia concept and category information. We develop two approaches, exact match and relatedness-match, to map text documents to Wikipedia concepts, and further to Wikipedia categories. Then the text documents are clustered based on a similarity metric which combines document content information, concept information as well as category information. The experimental results using the proposed clustering framework on three datasets (20-newsgroup, TDT2, and LA Times) show that clustering performance improves significantly by enriching document representation with Wikipedia concepts and categories. |
关 键 词: | 文本聚类方法; 语义信息; 相似性度量 |
课程来源: | 视频讲座网 |
最后编审: | 2019-11-22:cwx |
阅读次数: | 41 |