A Novel Attention-based Global and Local Information Fusion Neural Network for Group Recommendation

Song Zhang; Nan Zheng; Dan-Li Wang

doi:10.1007/s11633-022-1336-1

Volume 19 Issue 4

August 2022

Turn off MathJax

Article Contents

Relative Articles

Song Zhang, Nan Zheng, Dan-Li Wang. A Novel Attention-based Global and Local Information Fusion Neural Network for Group Recommendation. Machine Intelligence Research, vol. 19, no. 4, pp.331-346, 2022. https://doi.org/10.1007/s11633-022-1336-1

Citation:

Song Zhang, Nan Zheng, Dan-Li Wang. A Novel Attention-based Global and Local Information Fusion Neural Network for Group Recommendation. Machine Intelligence Research, vol. 19, no. 4, pp.331-346, 2022. https://doi.org/10.1007/s11633-022-1336-1

Citation:

PDF( 1585 KB)

A Novel Attention-based Global and Local Information Fusion Neural Network for Group Recommendation

doi: 10.1007/s11633-022-1336-1

Song Zhang^{1, 2, †

,},
Nan Zheng^{1, 2, †

,},
Dan-Li Wang^{1, 2

,}

1.
State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
2.
School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China

More Information

Author Bio:
Song Zhang received the B. Sc. degree in software engineering from Xiamen University, China in 2019. He is currently a master student in computer technology at University of Chinese Academy of Sciences, China. His research interests include data mining and machine learning. E-mail: zhangsong2019@ia.ac.cn ORCID iD: 0000-0001-5396-0003

Nan Zheng received the Ph. D. degree in computer application from Institute of Automation, Chinese Academy of Sciences, China in 2012. She is currently an associate professor at State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, China. She was a visiting scholar at University of California, Berkeley, USA from 2018 to 2019. Her research interests include data mining and machine learning. E-mail: nan.zheng@ia.ac.cnORCID iD: 0000-0002-8560-9231

Dan-Li Wang received the Ph. D. degree in computer application from Beihang University, China in 1999. She is currently a researcher at State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, China. Her research interests include complex systems, metasynthesis, group intelligence, human-computer interaction, psychosomatic computation, data mining and machine learning. E-mail: danli.wang@ia.ac.cn (Corresponding author)ORCID iD: 0000-0003-0980-5457
Received Date: 2022-03-02
Accepted Date: 2022-05-05
Publish Online: 2022-06-17
Publish Date: 2022-08-01

Abstract

Abstract

Due to the popularity of group activities in social media, group recommendation becomes increasingly significant. It aims to pursue a list of preferred items for a target group. Most deep learning-based methods on group recommendation have focused on learning group representations from single interaction between groups and users. However, these methods may suffer from data sparsity problem. Except for the interaction between groups and users, there also exist other interactions that may enrich group representation, such as the interaction between groups and items. Such interactions, which take place in the range of a group, form a local view of a certain group. In addition to local information, groups with common interests may also show similar tastes on items. Therefore, group representation can be conducted according to the similarity among groups, which forms a global view of a certain group. In this paper, we propose a novel global and local information fusion neural network (GLIF) model for group recommendation. In GLIF, an attentive neural network (ANN) activates rich interactions among groups, users and items with respect to forming a group′s local representation. Moreover, our model also leverages ANN to obtain a group′s global representation based on the similarity among different groups. Then, it fuses global and local representations based on attention mechanism to form a group′s comprehensive representation. Finally, group recommendation is conducted under neural collaborative filtering (NCF) framework. Extensive experiments on three public datasets demonstrate its superiority over the state-of-the-art methods for group recommendation.
- Group recommendation,
- attentive neural network (ANN),
- global information,
- local information,
- recommender system

¹ https://grouplens.org/datasets/movielens/
² https://github.com/hexiangnan/neural_collaborative_filtering³ https://github.com/sarinasajadi/DeepGroup/tree/main/dataset/sushi⁴ https://github.com/LianHaiMiao/Attentive-Group-Recommendation
† These authors contributed equally to this work and should be considered co-first authors.

FullText(HTML)

References(47)

References

[1]	L. Cui, J. Wu, D. C. Pi, P. Zhang, P. Kennedy. Dual implicit mining-based latent friend recommendation. IEEE Transactions on Systems,Man,and Cybernetics:Systems, vol. 50, no. 5, pp. 1663–1678, 2020. DOI: 10.1109/TSMC.2017.2777889.
[2]	S. S. Deng, L. T. Huang, G. D. Xu, X. D. Wu, Z. H. Wu. On deep learning for trust-aware recommendations in social networks. IEEE Transactions on Neural Networks and Learning Systems, vol. 28, no. 5, pp. 1164–1177, 2017. DOI: 10.1109/TNNLS.2016.2514368.
[3]	Z. H. Huang, S. J. E, J. W. Zhang, B. Zhang, Z. L. Ji. Pairwise learning to recommend with both users′ and items′ contextual information. IET Communications, vol. 10, no. 16, pp. 2084–2090, 2016. DOI: 10.1049/iet-com.2016.0112.
[4]	N. Zheng, S. Y. Song, H. Y. Bao. A temporal-topic model for friend recommendations in Chinese microblogging systems. IEEE Transactions on Systems,Man,and Cybernetics:Systems, vol. 45, no. 9, pp. 1245–1253, 2015. DOI: 10.1109/TSMC.2015.2391262. (in Chinese)
[5]	V. M. Le. Group recommendation techniques for feature modeling and configuration. In Proceedings of IEEE/ACM the 43rd International Conference on Software Engineering: Companion Proceedings, IEEE, Madrid, Spain, pp. 266–268, 2021. DOI: 10.1109/ICSE-Companion52605.2021.00123.
[6]	L. V. Nguyen, M. S. Hong, J. J. Jung, B. S. Sohn. Cognitive similarity-based collaborative filtering recommendation system. Applied Sciences, vol. 10, no. 12, Article number 4183, 2020. DOI: 10.3390/app10124183.
[7]	D. Rafailidis, A. Nanopoulos. Modeling users preference dynamics and side information in recommender systems. IEEE Transactions on Systems,Man,and Cybernetics:Systems, vol. 46, no. 6, pp. 782–792, 2016. DOI: 10.1109/TSMC.2015.2460691.
[8]	L. Hu, J. Cao, G. D. Xu, L. B. Cao, Z. P. Gu, C. Zhu. Personalized recommendation via cross-domain triadic factorization. In Proceedings of the 22nd International Conference on World Wide Web, ACM, Rio de Janeiro, Brazil, pp. 595–606, 2013. DOI: 10.1145/2488388.2488441.
[9]	S. Rendle. Factorization machines. In Proceedings of IEEE International Conference on Data Mining, IEEE, Sydney, Australia, pp. 995–1000, 2010. DOI: 10.1109/ICDM.2010.127.
[10]	Y. Koren, R. Bell, C. Volinsky. Matrix factorization techniques for recommender systems. Computer, vol. 42, no. 8, pp. 30–37, 2009. DOI: 10.1109/MC.2009.263.
[11]	Q. Yuan, G. Cong, C. Y. Lin. COM: A generative model for group recommendation. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, New York, USA, pp. 163–172, 2014. DOI: 10.1145/2623330.2623616.
[12]	X. J. Liu, Y. Tian, M. Ye, W. C. Lee. Exploring personal impact for group recommendation. In Proceedings of the 21st ACM International Conference on Information and Knowledge Management, ACM, Maui, USA, 2012, pp. 674–683. DOI: 10.1145/2396761.2396848.
[13]	S. S. Ghaemmaghami, A. Salehi-Abari. DeepGroup: Group recommendation with implicit feedback. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management, ACM, Queensland, Australia, pp. 3408–3412, 2021. DOI: 10.1145/3459637.3482081.
[14]	Z. H. Huang, X. Xu, H. H. Zhu, M. C. Zhou. An efficient group recommendation model with multiattention-based neural networks. IEEE Transactions on Neural Networks and Learning Systems, vol. 31, no. 11, pp. 4461–4474, 2020. DOI: 10.1109/TNNLS.2019.2955567.
[15]	D. Cao, X. N. He, L. H. Miao, Y. H. An, C. Yang, R. C. Hong. Attentive group recommendation. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, ACM, Ann Arbor, USA, pp. 645–654, 2018. DOI: 10.1145/3209978.3209998.
[16]	Z. X. He, C. Y. Chow, J. D. Zhang, N. Li. GRADI: Towards group recommendation using attentive dual top-down and bottom-up influences. In Proceedings of IEEE International Conference on Big Data, IEEE, Los Angeles, USA, pp. 631–636, 2019. DOI: 10.1109/BigData47090.2019.9005686.
[17]	L. V. Tran, T. A. N. Pham, Y. Tay, Y. D. Liu, G. Cong, X. L. Li. Interact and decide: Medley of sub-attention networks for effective group recommendation. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, Paris, France, pp. 255–264, 2019. DOI: 10.1145/3331184.3331251.
[18]	Z. X. He, C. Y. Chow, J. D. Zhang. GAME: Learning graphical and attentive multi-view embeddings for occasional group recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, China, pp. 649–658, 2020. DOI: 10.1145/3397271.3401064.
[19]	A. Said, S. Berkovsky, E. W. De Luca. Group recommendation in context. In Proceedings of the 2nd Challenge on Context-aware Movie Recommendation, ACM, Chicago, USA, pp. 2–4, 2011. DOI: 10.1145/2096112.2096113.
[20]	L. Hu, S. L. Jian, L. B. Cao, Z. P. Gu, Q. K. Chen, A. Amirbekyan. HERS: Modeling influential contexts with heterogeneous relations for sparse and cold-start recommendation. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence, AAAI, Honolulu, USA, pp. 3830–3837, 2019. DOI: 10.1609/aaai.v33i01.33013830.
[21]	C. Y. Yin, L. F. Shi, R. X. Sun, J. Wang. Improved collaborative filtering recommendation algorithm based on differential privacy protection. The Journal of Supercomputing, vol. 76, no. 7, pp. 5161–5174, 2020. DOI: 10.1007/s11227-019-02751-7.
[22]	X. N. He, L. Z. Liao, H. W. Zhang, L. Q. Nie, X. Hu, T. S. Chua. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web, ACM, Perth, Australia, pp. 173–182, 2017. DOI: 10.1145/3038912.3052569.
[23]	J. K. Wang, Y. C. Jiang, J. S. Sun, Y. Z. Liu, X. Liu. Group recommendation based on a bidirectional tensor factorization model. World Wide Web, vol. 21, no. 4, pp. 961–984, 2018. DOI: 10.1007/s11280-017-0493-6.
[24]	L. Baltrunas, T. Makcinskas, F. Ricci. Group recommendations with rank aggregation and collaborative filtering. In Proceedings of the 4th ACM Conference on Recommender Systems, ACM, Barcelona, Spain, pp. 119–126, 2010. DOI: 10.1145/1864708.1864733.
[25]	S. Berkovsky, J. Freyne. Group-based recipe recommendations: Analysis of data aggregation strategies. In Proceedings of the 4th ACM Conference on Recommender Systems, ACM, Barcelona, Spain, pp. 111–118, 2010. DOI: 10.1145/1864708.1864732.
[26]	S. Amer-Yahia, S. B. Roy, A. Chawlat, G. Das, C. Yu. Group recommendation: Semantics and efficiency. Proceedings of the VLDB Endowment, vol. 2, no. 1, pp. 754–765, 2009. DOI: 10.14778/1687627.1687713.
[27]	L. Boratto, S. Carta. State-of-the-art in group recommendation and new approaches for automatic identification of groups. In Information Retrieval and Mining in Distributed Environments, A. Soro, E. Vargiu, G. Armano, G. Paddeu, Eds., Berlin, Germany, Springer, pp. 1–20, 2010. DOI: 10.1007/978-3-642-16089-9_1.
[28]	L. Guo, H. Z. Yin, Q. Y. Wang, B. Cui, Z. Huang, L. Z. Cui. Group recommendation with latent voting mechanism. In Proceedings of the 36th IEEE International Conference on Data Engineering, IEEE, Dallas, USA, pp. 121–132, 2020. DOI: 10.1109/ICDE48307.2020.00018.
[29]	J. F. McCarthy, T. D. Anagnost. MusicFX: An arbiter of group preferences for computer supported collaborative workouts. In Proceedings of ACM Conference on Computer Supported Cooperative Work, ACM, Seattle, USA, pp. 363–372, 1998. DOI: 10.1145/289444.289511.
[30]	Z. W. Yu, X. S. Zhou, Y. B. Hao, J. H. Gu. TV program recommendation for multiple viewers based on user profile merging. User Modeling and User-adapted Interaction, vol. 16, no. 1, pp. 63–82, 2006. DOI: 10.1007/s11257-006-9005-6.
[31]	S. S. Feng, H. X. Zhang, L. Wang, L. Liu, Y. C. Xu. Detecting the latent associations hidden in multi-source information for better group recommendation. Knowledge-Based Systems, vol. 171, pp. 56–68, 2019. DOI: 10.1016/j.knosys.2019.02.002.
[32]	M. Ye, X. J. Liu, W. C. Lee. Exploring social influence for recommendation: A generative model approach. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, Portland, USA, pp. 671–680, 2012. DOI: 10.1145/2348283.2348373.
[33]	L. J. Zhou, J. W. Dang, Z. H. Zhang. Fault classification for on-board equipment of high-speed railway based on attention capsule network. International Journal of Automation and Computing, vol. 18, no. 5, pp. 814–825, 2021. DOI: 10.1007/s11633-021-1291-2.
[34]	X. Zhang, Q. Yang. Correction to: Transfer hierarchical attention network for generative dialog system. International Journal of Automation and Computing, vol. 18, no. 5, Article number 856, 2021. DOI: 10.1007/s11633-020-1223-6.
[35]	J. Orbach. Principles of neurodynamics. Perceptrons and the theory of brain mechanisms. Archives of General Psychiatry, vol. 7, no. 3, pp. 218–219, 1962. DOI: 10.1001/archpsyc.1962.01720030064010.
[36]	L. Guo, H. Z. Yin, T. Chen, X. L. Zhang, K. Zheng. Hierarchical hyperedge embedding-based representation learning for group recommendation. ACM Transactions on Information Systems, vol. 40, no. 1, Article number 3, 2021. DOI: 10.1145/3457949.
[37]	X. Glorot, Y. Bengio. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, Sardinia, Italy, pp. 249–256, 2010.
[38]	M. McPherson, L. Smith-Lovin, J. M. Cook. Birds of a feather: Homophily in social networks. Annual Review of Sociology, vol. 27, pp. 415–444, 2001. DOI: 10.1146/annurev.soc.27.1.415.
[39]	H. F. Liu, E. P. Lim, H. W. Lauw, M. T. Le, A. X. Sun, J. Srivastava, Y. A. Kim. Predicting trusts among users of online communities: An epinions case study. In Proceedings of the 9th ACM Conference on Electronic Commerce, ACM, Chicago, USA, pp. 310–319, 2008. DOI: 10.1145/1386790.1386838.
[40]	L. Hu, J. Cao, G. D. Xu, L. B. Cao, Z. P. Gu, W. Cao. Deep modeling of group preferences for group-based recommendation. In Proceedings of the 28th AAAI Conference on Artificial Intelligence, AAAI, Québec City, Canada, pp. 1861–1867, 2014. DOI: 10.5555/2892753.2892811.
[41]	H. Z. Yin, Q. Y. Wang, K. Zheng, Z. X. Li, J. L. Yang, X. F. Zhou. Social influence-based group representation learning for group recommendation. In Proceedings of the 35th IEEE International Conference on Data Engineering, IEEE, Macao, China, pp. 566–577, 2019. DOI: 10.1109/ICDE.2019.00057.
[42]	P. Sedgwick. Pearson′s correlation coefficient. BMJ, vol. 345, Article number e4483, 2012. DOI: 10.1136/bmj.e4483.
[43]	J. Y. Chen, H. W. Zhang, X. N. He, L. Q. Nie, W. Liu, T. S. Chua. Attentive collaborative filtering: Multimedia recommendation with item-and component-level attention. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, Shinjuku, Japan, pp. 335–344, 2017. DOI: 10.1145/3077136.3080797.
[44]	S. Rendle, C. Freudenthaler, Z. Gantner, L. Schmidt-Thieme. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence, Montreal, Canada, pp. 452–461, 2009.
[45]	X. N. He, H. W. Zhang, M. Y. Kan, T. S. Chua. Fast matrix factorization for online recommendation with implicit feedback. In Proceedings of the 39th International Conference on Research and Development in Information Retrieval, ACM, Pisa, Italy, pp. 549–558, 2016. DOI: 10.1145/2911451.2911489.
[46]	Y. Koren. Factorization meets the neighborhood: A multifaceted collaborative filtering model. In Proceedings of the 14th International Conference on Knowledge Discovery and Data Mining, ACM, Las Vegas, USA, pp. 426–434, 2008. DOI: 10.1145/1401890.1401944.
[47]	A. M. Elkahky, Y. Song, X. D. He. A multi-view deep learning approach for cross domain user modeling in recommendation systems. In Proceedings of the 24th International Conference on World Wide Web, ACM, Florence, Italy, pp. 278–288, 2015. DOI: 10.1145/2736277.2741667.

Relative Articles

Supplements(0)

Cited By

Proportional views

Proportional views

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

Figures(8) / Tables(3)

Get Citation

PDF

XML

Entire Issue PDF

用微信扫码二维码

分享至好友和朋友圈

Article Metrics

Article views (652) PDF downloads(111)

A Novel Attention-based Global and Local Information Fusion Neural Network for Group Recommendation

doi: 10.1007/s11633-022-1336-1

Abstract

References

Proportional views

Catalog

通讯作者: 陈斌, bchen63@163.com

Article Metrics

Proportional views

Related

A Novel Attention-based Global and Local Information Fusion Neural Network for Group Recommendation

doi: 10.1007/s11633-022-1336-1

Abstract

References

Proportional views

Catalog

通讯作者: 陈斌, bchen63@163.com

Article Metrics

Proportional views

Related

Export File

Citation

Format

Content