论文标题
购物外观：在Pinterest上建立大规模的视觉购物系统
Shop The Look: Building a Large Scale Visual Shopping System at Pinterest
论文作者
论文摘要
随着在线内容变得越来越视觉，通过视觉查询进行搜索的需求变得相应地增长。购物外观是Pinterest的在线购物发现服务，利用视觉搜索使用户能够在图像中查找和购买产品。在这项工作中，我们提供了一个整体的看法，即我们如何建造面貌，面向购物的视觉搜索系统，以及从满足购物需求中学到的经验教训。我们讨论主题，包括跨对象检测和视觉嵌入的核心技术，为实时推理提供基础架构，以及用于培训/评估数据收集和人类评估的数据标记方法。我们的系统设计选择的面向用户影响是通过离线评估，人类相关性判断和在线A/B实验来衡量的。集体改进的相对相对增长超过160％，在端到端的人类相关性判断和参与度的80％以上。购物外观在Pinterest的生产中部署。
As online content becomes ever more visual, the demand for searching by visual queries grows correspondingly stronger. Shop The Look is an online shopping discovery service at Pinterest, leveraging visual search to enable users to find and buy products within an image. In this work, we provide a holistic view of how we built Shop The Look, a shopping oriented visual search system, along with lessons learned from addressing shopping needs. We discuss topics including core technology across object detection and visual embeddings, serving infrastructure for realtime inference, and data labeling methodology for training/evaluation data collection and human evaluation. The user-facing impacts of our system design choices are measured through offline evaluations, human relevance judgements, and online A/B experiments. The collective improvements amount to cumulative relative gains of over 160% in end-to-end human relevance judgements and over 80% in engagement. Shop The Look is deployed in production at Pinterest.
