0


分段线性神经网络的精确一致解释:一种闭式解

Exact and Consistent Interpretation for Piecewise Linear Neural Networks: A Closed Form Solution
课程网址: http://videolectures.net/kdd2018_chu_neural_networks/  
主讲教师: Lingyang Chu
开课单位: 西蒙·弗雷泽大学
开课时间: 2018-11-23
课程语种: 英语
中文简介:
网络嵌入旨在将网络嵌入到低维向量空间中,同时保持网络固有的结构财产,近年来受到了广泛关注。现有的大多数嵌入方法都将节点作为点向量嵌入到低维连续空间中。通过这种方式,边缘的形成是确定的,并且仅由节点的位置决定。然而,现实世界网络的形成和演化充满了不确定性,这使得这些方法不是最优的。为了解决这个问题,本文提出了一种新的嵌入Wasserstein空间的深度变分网络(DVNE)。所提出的方法学习Wasserstein空间中的高斯分布作为每个节点的潜在表示,这可以同时保持网络结构并对节点的不确定性进行建模。具体地说,我们使用2-Wasserstein距离作为分布之间的相似性度量,这可以在具有线性计算成本的情况下很好地保持网络中的传递性。此外,我们的方法通过深度变分模型暗示了均值和方差的数学相关性,该模型可以很好地通过均值向量捕捉节点的位置,通过方差捕捉节点的不确定性。此外,我们的方法通过保持网络中的一阶和二阶邻近性来捕获局部和全局网络结构。我们的实验结果表明,与最先进的方法相比,我们的方法可以有效地对网络中节点的不确定性进行建模,并在链路预测和多标签分类等实际应用中取得了显著的进步。
课程简介: Network embedding, aiming to embed a network into a low dimensional vector space while preserving the inherent structural properties of the network, has attracted considerable attentions recently. Most of the existing embedding methods embed nodes as point vectors in a low-dimensional continuous space. In this way, the formation of the edge is deterministic and only determined by the positions of the nodes. However, the formation and evolution of real-world networks are full of uncertainties, which makes these methods not optimal. To address the problem, we propose a novel Deep Variational Network Embedding in Wasserstein Space (DVNE) in this paper. The proposed method learns a Gaussian distribution in the Wasserstein space as the latent representation of each node, which can simultaneously preserve the network structure and model the uncertainty of nodes. Specifically, we use 2-Wasserstein distance as the similarity measure between the distributions, which can well preserve the transitivity in the network with a linear computational cost. Moreover, our method implies the mathematical relevance of mean and variance by the deep variational model, which can well capture the position of the node by the mean vectors and the uncertainties of nodes by the variance. Additionally, our method captures both the local and global network structure by preserving the first-order and second-order proximity in the network. Our experimental results demonstrate that our method can effectively model the uncertainty of nodes in networks, and show a substantial gain on real-world applications such as link prediction and multi-label classification compared with the state-of-the-art methods.
关 键 词: 分段线性神经网络; 网络的精确一致解释; 2-Wasserstein距离; 深度变分模型; 深度变分网络
课程来源: 视频讲座网
数据采集: 2023-03-27:cyh
最后编审: 2023-03-27:cyh
阅读次数: 16