图 书 馆
适用于大数据和稀疏数据的可扩展PARAFAC2SPARTan: Scalable PARAFAC2 for Large & Sparse Data |
|
| 课程网址: | https://videolectures.net/videos/kdd2017_perros_SPARTan |
| 主讲教师: | Ioakeim Perros |
| 开课单位: | KDD 2017研讨会 |
| 开课时间: | 2017-10-09 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | In exploratory tensor mining, a common problem is how to analyze a set of variables across a set of subjects whose observations do not align naturally. For example, when modeling medical features across a set of patients, the number and duration of treatments may vary widely in time, meaning there is no meaningful way to align their clinical records across time points for analysis purposes. To handle such data, the state-of-the-art tensor model is the so-called PARAFAC2, which yields interpretable and robust output and can naturally handle sparse data. However, its main limitation up to now has been the lack of efficient algorithms that can handle large-scale datasets. In this work, we fill this gap by developing a scalable method to compute the PARAFAC2 decomposition of large and sparse datasets, called SPARTan. Our method exploits special structure within PARAFAC2, leading to a novel algorithmic reformulation that is both faster (in absolute time) and more memory-efficient than prior work. We evaluate SPARTan on both synthetic and real datasets, showing 22X performance gains over the best previous implementation and also handling larger problem instances for which the baseline fails. Furthermore, we are able to apply SPARTan to the mining of temporally-evolving phenotypes on data taken from real and medically complex pediatric patients. The clinical meaningfulness of the phenotypes identified in this process, as well as their temporal evolution over time for several patients, have been endorsed by clinical experts. |
| 关 键 词: | 大数据; 稀疏数据; 高效算法 |
| 课程来源: | 视频讲座网 |
| 数据采集: | 2024-12-25：liyq |
| 最后编审: | 2024-12-26：liyq |
| 阅读次数: | 11 |