Y. Li, C. Chen, M. Duan, Z. Zeng and K. Li, "Attention-Aware Encoder–Decoder Neural Networks for Heterogeneous Graphs of Things," in IEEE Transactions on Industrial Informatics, vol. 17, no. 4, pp. 2890-2898, April 2021, doi: 10.1109/TII.2020.3025592.
Abstract:
Recent trend focuses on using heterogeneous graph of things (HGoT) to represent things and their relations in the Internet of Things, thereby facilitating the applying of advanced learning frameworks, i.e., deep learning (DL). Nevertheless, this is a challenging task since the existing DL models are hard to accurately express the complex semantics and attributes for those heterogeneous nodes and links in HGoT. To address this issue, we develop attention-aware encoder–decoder graph neural networks for HGoT, termed as HGAED. Specifically, we utilize the attention-based separate-and-merge method to improve the accuracy, and leverage the encoder–decoder architecture for implementation. In the heart of HGAED, the separate-and-merge processes can be encapsulated into encoding and decoding blocks. Then, blocks are stacked for constructing an encoder–decoder architecture to jointly and hierarchically fuse heterogeneous structures and contents of nodes. Extensive experiments on three real-world datasets demonstrate the superior performance of HGAED over state-of-the-art baselines.
License type:
PublisherCopyrights
Funding Info:
These research / projects are supported by the National Natural Science Foundation of China (Grant No.61902120), under its <Multi-Source Multi-Target Deep Neural Networks based on Novel Parallel/Distributed CPU/GPU Hybrid Architecture for Train Fault Detection (MT-DNN, EC-2016-112)