论文标题
二元化图神经网络
Binarized Graph Neural Network
论文作者
论文摘要
最近,图形分析中有一些突破,通过按照邻里聚合方案应用图形神经网络(GNN),这在许多任务中都表现出了出色的表现。但是,我们观察到,在现有的基于GNN的图形嵌入方法中,网络的参数和节点的嵌入在实价矩阵中表示,这可能会限制这些模型的效率和可扩展性。众所周知,二进制向量通常比实值矢量更有空间和时间效率。这促使我们开发一个二进制图神经网络,以在基于GNN的范式之后以二进制网络参数学习节点的二进制表示。我们提出的方法可以无缝集成到现有的基于GNN的嵌入方法中,以将模型参数二进制并学习紧凑的嵌入。广泛的实验表明,所提出的二进制图神经网络(即BGN)在与最先进的性能相匹配的同时,在时间和空间方面效率更高。
Recently, there have been some breakthroughs in graph analysis by applying the graph neural networks (GNNs) following a neighborhood aggregation scheme, which demonstrate outstanding performance in many tasks. However, we observe that the parameters of the network and the embedding of nodes are represented in real-valued matrices in existing GNN-based graph embedding approaches which may limit the efficiency and scalability of these models. It is well-known that binary vector is usually much more space and time efficient than the real-valued vector. This motivates us to develop a binarized graph neural network to learn the binary representations of the nodes with binary network parameters following the GNN-based paradigm. Our proposed method can be seamlessly integrated into the existing GNN-based embedding approaches to binarize the model parameters and learn the compact embedding. Extensive experiments indicate that the proposed binarized graph neural network, namely BGN, is orders of magnitude more efficient in terms of both time and space while matching the state-of-the-art performance.