论文标题
标量还不够:基于矢量化的无偏学习来排名
Scalar is Not Enough: Vectorization-based Unbiased Learning to Rank
论文作者
论文摘要
公正的学习排名(ULTR)旨在从有偏见的用户点击日志中训练公正的排名模型。当前的大多数超级方法基于考试假设(EH),该假设假设可以将点击概率分解为两个标量函数,一种与排名特征有关,另一个与偏见因素有关。不幸的是,在实践中,特征,偏见因素和点击之间的相互作用很复杂,通常不能以这种独立的方式分解。使用EH拟合点击数据可能会导致模型错误指定并带来近似错误。 在本文中,我们提出了一个基于向量的EH,并将点击概率作为两个向量函数的点产物提出。该解决方案由于拟合任意点击功能的通用性而完成。基于它,我们提出了一个名为Vectorization的新型模型,以通过将嵌入在基本向量上的嵌入来自适应地学习相关性嵌入和排序文档。广泛的实验表明,我们的方法在复杂的真实点击以及简单的模拟点击上大大优于最新的超级方法。
Unbiased learning to rank (ULTR) aims to train an unbiased ranking model from biased user click logs. Most of the current ULTR methods are based on the examination hypothesis (EH), which assumes that the click probability can be factorized into two scalar functions, one related to ranking features and the other related to bias factors. Unfortunately, the interactions among features, bias factors and clicks are complicated in practice, and usually cannot be factorized in this independent way. Fitting click data with EH could lead to model misspecification and bring the approximation error. In this paper, we propose a vector-based EH and formulate the click probability as a dot product of two vector functions. This solution is complete due to its universality in fitting arbitrary click functions. Based on it, we propose a novel model named Vectorization to adaptively learn the relevance embeddings and sort documents by projecting embeddings onto a base vector. Extensive experiments show that our method significantly outperforms the state-of-the-art ULTR methods on complex real clicks as well as simple simulated clicks.