图 书 馆
挖掘统计上重要的等价类Mining Statistically Important Equivalence Classes |
|
| 课程网址: | http://videolectures.net/kdd07_li_msie/ |
| 主讲教师: | Jinyan Li |
| 开课单位: | 信息通信研究所 |
| 开课时间: | 2007-08-14 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | The support condence framework is the most common measure used in itemset mining algorithms, for its antimonotonicity that efectively simplifies the search lattice. This computational convenience brings both quality and statistical laws to the results as observed by many previous studies. In this paper, we introduce a novel algorithm that produces itemsets with ranked statistical merits under sophisticated test statistics such as chi-square, risk ratio, odds ratio, etc. Our algorithm is based on the concept of equivalence classes. An equivalence class is a set of frequent itemsets that always occur together in the same set of transactions. Therefore, itemsets within an equivalence class all share the same level of statistical signifiance regardless of the variety of test statistics. As an equivalence class can be uniquely determined and concisely represented by a closed pattern and a set of generators, we just mine closed patterns and generators, taking a simultaneous depth first search scheme. This parallel approach has not been exploited by any prior work. We evaluate our algorithm on two aspects. In general, we compare to LCM and FPclose which are the best algorithms tailored for mining only closed patterns. In particular, we compare to epMiner which is the most recent algorithm for mining a type of relative risk patterns, known as minimal emerging patterns. Experimental results show that our algorithm is faster than all of them, sometimes even multiple orders of magnitude faster. These statistically ranked patterns and the eficiency have a high potential for real life applications, especially in biomedical and nancial fields where classical test statistics are of dominant interest. |
| 关 键 词: | 项集挖掘算法; 搜索点阵; 同时深度优先搜索方案; 最小新兴模式 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2019-05-09：cjy |
| 阅读次数: | 32 |