Dual-View Fusion of Heterogeneous Information Network Embedding for Recommendation
Keywords:
Heterogeneous Information Network, Network Embedding, Attention Mechanism, Recommender SystemAbstract
Heterogeneous Information Networks (HINs) contain rich semantic information due to their involvement of multiple types of nodes and edges. Heterogeneous network embedding is used to analyze HINs by embedding network information in low-dimensional node representations. However, existing heterogeneous embedding methods either ignore the implicit topological relationships between distant nodes or neglect nodes features and meta-paths information disparities, which reflects that extracting HIN embeddings from a single view may lead to incomplete information extraction. In order to make the information extraction more complete, we propose a dual-view fusion heterogeneous information network embedding method (DFHE) for recommendation tasks. Specifically, it extracts effective features from HINs from both the remote topology view and the semantic aggregation view: the remote topology view uses a meta-graph-guided random walk to capture the topological relationships between remote nodes and learns embeddings through a graph convolutional network (GCN) encoder, while the semantic aggregation view uses an attention mechanism to learn the importance of different meta-paths, node relationships, and aggregates the semantic information of each meta-path. Experimental results on two real-world network datasets demonstrate an enhancement in recommendation task performance under the application of DFHE, compared to the baseline. This improvement persists even when some meta-paths are deleted, thereby verifying the method’s effectiveness.
Downloads
References
X. Chen, H. Liu, and D.Yang, “Improved LSH for privacy-aware and robust recommender system with sparse data in edge environment,”EURASIP Journal on Wireless Communications and Networking, vol.171, pp. 1-11, 2019. DOI: 10.1186/s13638-019-1478-1
Y. Chen, X. Xie, and W. Weng, “Content and Structure Based Attention for Graph Node Classification,” Journal of Intelligent & Fuzzy Systems, pp. 1–15, 2024. DOI:10.3233/JIFS-223304
M. Han, H. Zhang, W. Li, and Y. Yin, “Semantic-guided graph neural network for heterogeneous graph embedding,” Expert Systems with Applications, vol. 232, pp. 120810, 2023. DOI: 10.1016/j.eswa.2023.120810
S. Zhang, J. Zhang, X. Song, S. Adeshina, D.Zheng, C. Faloutsos, and Y. Sun, “PaGE-Link: Path-based graph neural network explanation for heterogeneous link prediction,” in Proceedings of the ACM Web Conference, pp. 3784–3793, 2023. DOI: 10.1145/3543507.3583511
Z. Zhang, H. Xu, Y. Li, Z. Zhai, and Y. Ding, “NAGNE: Node-to-Attribute Generation Network Embedding for Heterogeneous Network,” Applied Sciences, vol. 14, no. 3, pp. 1053, 2024. DOI: 10.3390/app14031053
Z. La, Y. Qian, H. Leng, T. Gu, W.Gong, and J. Chen, “MC-GAT: Multi-Channel Graph Attention Networks for Capturing Diverse Information in Complex Graphs,” Cognitive Computation, vol. 16, no. 2, pp. 595-607, 2024. DOI: 10.1007/s12559-023-10222-8
B. Zeng, J. Chi, P. Hong, G. Lu, D. Zhang, and B. Chen, “Contextaware graph embedding with gate and attention for session-based recommendation,” Neurocomputing, vol. 574, pp. 127221, 2024 DOI: 10.1016/j.neucom.2023.127221
B. Perozzi, R. Al-Rfou, and S. Skiena, “Deepwalk: Online learning of social representations,” in Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 701–710, 2014. DOI: 10.1145/2623330.2623732
J. Tang, M. Qu, M. Wang, M. Zhang, J. Yan, and Q. Mei, “Line: Large-scale information network embedding,” in Proceedings of the 24th International Conference on World Wide Web, pp. 1067–1077, 2015. DOI: 10.1145/2736277.2741093
A. Grover and J. Leskovec, “Node2vec: Scalable feature learning for networks,” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 855–864, 2016. DOI:10.1145/2939672.2939754
T. Liu, J. Yin, and Q. Qin, “MFHE: Multi-view fusion-based heterogeneous information network embedding,” Applied Sciences, vol. 12, no.16, pp. 8218, 2022. DOI:10.3390/app12168218
Y. Dong, N. V. Chawla, and A. Swami, “Metapath2vec: Scalable representation learning for heterogeneous networks,” in Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 135–144, 2017. DOI: 10.1145/3097983.3098036
Y. He, Y. Zhang, L. Qi, D. Yan, and Q. He, “Outer product enhanced heterogeneous information network embedding for recommendation,” Expert Systems with Applications, vol.169, pp. 114359, 2021. DOI: 10.1016/j.eswa.2020.114359
Z. Zhao, Zhang X, H. Zhou, C. Li, and M. Gong, “HetNERec: Heterogeneous network embedding based recommendation,” Knowledge-Based Systems, vol.204, pp. 106218, 2020. DOI: 10.1016/j.knosys.2020.106218
T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean, “Distributed representations of words and phrases and their compositionality,” Advances in neural information processing systems, vol. 26, 2013. DOI: 10.7551/mitpress/7503.001.0001
D. Zhang, J. Yin, X. Zhu, and C. Zhang, “Metagraph2vec: Complex semantic path augmented heterogeneous network embedding,” in Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 196–208, 2018. DOI: 10.1007/978-3-319-93037-4_16
P. Velickovic, G. Cucurull, A. Casanova, A. Romero, P. Lio, and Y. Bengio, “Graph attention networks,” arXiv preprint, arXiv:1710.10903, 2017. DOI: 10.48550/arXiv.1710.10903
X. Wang, H. Ji, C. Shi, B. Wang, Y. Ye, P. Cui, and P. Yu, “Heterogeneous graph attention network,” in The World Wide Web Conference, pp. 2022–2032, 2019. DOI: 10.1145/3308558.3313562
X. Fu, J. Zhang, Z. Meng, and I. King, “Magnn: Metapath aggregated graph neural network for heterogeneous graph embedding,” in Proceedings of the Web Conference, pp. 2331–2341, 2020. DOI: 10.1145/3366423.3380297
H. Du, C. Ma, D. Lu, and J. Liu, “HHSE: heterogeneous graph neural network via higher-order semantic enhancement,” pp. 1–23, 2024. DOI: 10.1007/s00607-023-01246-x
J. Yu and X. Li, “Heterogeneous Graph Contrastive Learning with Metapath Contexts and Weighted Negative Samples,” in Proceedings of the 2023 SIAM International Conference on Data Mining(SDM), pp. 37–45, 2023. DOI: 10.1137/1.9781611977653.ch5
C. Shi, B. Hu, W. Zhao, and P.Yu, “Heterogeneous information network embedding for recommendation,” IEEE Transactions on Knowledge and Data Engineering, vol. 31, no.2, pp. 357-370, 2018. DOI: 10.1109/TKDE.2018.2833443
T. Mikolov, K. Chen, G. Corrado, and J. Dean, “Efficient estimation of word representations in vector space,” arXiv preprint, arXiv:1301.3781, 2013. DOI: 10.48550/arXiv.1301.3781
D. Wang, P. Cui, and W. Zhu, “Structural deep network embedding,” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1225–1234, 2016. DOI: 10.1145/2939672.2939753
S. Forouzandeh, K. Berahmand, R. Sheikhpour, and Y. Li, “A new method for recommendation based on embedding spectral clustering in heterogeneous networks (RESCHet),” Expert Systems with Applications, pp. 120699, 2023. DOI: 10.1016/j.eswa.2023.120699
W. Ning, R. Cheng, J. Shen, N. H. Haldar, B. Kao, X. Yan, N. Huo, W. K. Lam, T. Li, and B. Tang, “Automatic meta-path discovery
for effective graph-based recommendation,” in Proceedings of the 31st ACM International Conference Information and Knowledge Management, pp. 1563–1572, 2022. DOI: 10.1145/3511808.3557244
H. Wang, J. Wang, J. Wang, M. Zhao, W. Zhang, F. Zhang, X. Xie, and M. Guo, “GraphGAN: Graph representation learning with generative adversarial nets,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol.32, no.1, 2018. DOI: 10.1609/aaai.v32i1.11872
T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” arXiv preprint, arXiv:1609.02907, 2016. DOI: 10.48550/arXiv.1609.02907
D. Jin, C. Huo, C. Liang, and L. Yang, “Heterogeneous graph neural network via attribute completion,” in Proceedings of the Web Conference, pp. 391–400, 2021. DOI: 10.1145/3442381.3449914
Z. Han , M. U. Anwaar, S. Arumugaswamy, T. Weber, T. Qiu, H. Shen, Y. Liu, and M. Kleinsteuber, “Metapath-and entity-aware graph neural network for recommendation,” arXiv preprint, arXiv:2010.11793, 2020. DOI:10.48550/arXiv.2010.11793
S. Rendle, C. Freudenthaler, Z. Gantner, and L. Schmidt-Thieme, “BPR: bayesian personalized ranking from implicit feedback,” in Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence, pp. 452– 461, 2009. DOI: 10.48550/arXiv.1205.2618
X. He, L. Liao, H. Zhang, L. Nie, X. Hu, and T.-S. Chua, “Neural collaborative filtering,” in Proceedings of the 26th International Conference on World Wide Web, pp. 173–182, 2017. DOI: 10.1145/3038912.3052569
F. Zhang, N. J. Yuan, D. Lian, X. Xie, and W. Ma. “Collaborative knowledge base embedding for recommender systems,” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 353–362, 2016. DOI: 10.1145/2939672.2939673
Y. Zhang, Q. Ai, X. Chen, and P. Wang, “Learning over knowledge-base embeddings for recommendation,” arXiv preprint, arXiv:1803.06540, 2018. DOI: 10.48550/arXiv.1803.06540
Z. Han, F. Xu, J. Shi, Y. Shang, H. Ma, P. Hui, and Y. Li, “Genetic meta-structure search for recommendation on heterogeneous information network,” in Proceedings of the 29th ACM International Conference on Information and Knowledge Management, pp. 455–464, 2020. DOI: 10.1145/3340531.3412015
X. Wang, X. He, Y. Cao, M. Liu, and T.-S. Chua, “Kgat: Knowledge graph attention network for recommendation,” in Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 950–958, 2019. DOI: 10.1145/3292500.3330989
B. Hu, C. Shi, W. X. Zhao, and P. S. Yu, “Leveraging meta-path based context for top-n recommendation with a neural co-attention model,” in Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1531–1540, 2018. DOI: 10.1145/3219819.3219965
