论文标题

基于协作图的多媒体推荐模型

A multimedia recommendation model based on collaborative graph

论文作者

Lim, Breda, Bansal, Shubhi, Buru, Ahmed, Manthey, Kayla

论文摘要

作为信息超载问题的主要解决方案之一,推荐系统在日常生活中广泛使用。在最近的新兴微视频推荐方案中,微视频包含丰富的多媒体信息,涉及文本,图像,视频和其他多模式数据,这些丰富的多模式信息掩盖了用户对项目的深切兴趣。当前的大多数建议算法基于多模式数据使用多模式信息来扩展项目方面的信息,但忽略了用户对不同模态信息的不同偏好,并且缺乏多模式信息内部连接的细粒度挖掘。 To investigate the problems in the micro-video recommendr system mentioned above, we design a hybrid recommendation model based on multimodal information, introduces multimodal information and user-side auxiliary information in the network structure, fully explores the deep interest of users, measures the importance of each dimension of user and item feature representation in the scoring prediction task, makes the application of graph neural network in the recommendation system is improved by using an attention mechanism to fuse the多层状态输出信息,允许中间层提供的浅结构特征,以更好地参与预测任务。与在不同数据集的传统建议算法相比,建议精度得到提高,并且我们的模型的可行性和有效性得到了验证。

As one of the main solutions to the information overload problem, recommender systems are widely used in daily life. In the recent emerging micro-video recommendation scenario, micro-videos contain rich multimedia information, involving text, image, video and other multimodal data, and these rich multimodal information conceals users' deep interest in the items. Most of the current recommendation algorithms based on multimodal data use multimodal information to expand the information on the item side, but ignore the different preferences of users for different modal information, and lack the fine-grained mining of the internal connection of multimodal information. To investigate the problems in the micro-video recommendr system mentioned above, we design a hybrid recommendation model based on multimodal information, introduces multimodal information and user-side auxiliary information in the network structure, fully explores the deep interest of users, measures the importance of each dimension of user and item feature representation in the scoring prediction task, makes the application of graph neural network in the recommendation system is improved by using an attention mechanism to fuse the multi-layer state output information, allowing the shallow structural features provided by the intermediate layer to better participate in the prediction task. The recommendation accuracy is improved compared with the traditional recommendation algorithm on different data sets, and the feasibility and effectiveness of our model is verified.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源