论文标题
回归兼容列表的校准排名与二进制相关性的目标
Regression Compatible Listwise Objectives for Calibrated Ranking with Binary Relevance
论文作者
论文摘要
由于学习对级(LTR)的方法主要寻求提高排名质量,因此他们的产出得分未通过设计尺寸校准。这从根本上限制了对分数敏感应用中的LTR使用。尽管结合回归和排名目标的简单多目标方法可以有效地学习尺度校准的分数,但我们认为这两个目标不一定兼容,这使得对他们中的任何一个的权衡都不那么理想。在本文中,我们提出了一种实践回归兼容排名(RCR)方法,该方法实现了更好的权衡,其中两个排名和回归成分被证明是相互对准的。尽管同样的想法适用于二进制和分级相关性的排名,但我们主要关注本文的二进制标签。我们在几个公共LTR基准上评估了所提出的方法,并表明它在回归和排名指标方面始终取得了最佳或竞争性的结果,并在多目标优化的背景下显着改善了帕累托前沿。此外,我们在YouTube搜索上评估了拟议的方法,发现它不仅提高了生产PCTR模型的排名质量,而且还提高了点击预测准确性。所提出的方法已成功部署在YouTube生产系统中。
As Learning-to-Rank (LTR) approaches primarily seek to improve ranking quality, their output scores are not scale-calibrated by design. This fundamentally limits LTR usage in score-sensitive applications. Though a simple multi-objective approach that combines a regression and a ranking objective can effectively learn scale-calibrated scores, we argue that the two objectives are not necessarily compatible, which makes the trade-off less ideal for either of them. In this paper, we propose a practical regression compatible ranking (RCR) approach that achieves a better trade-off, where the two ranking and regression components are proved to be mutually aligned. Although the same idea applies to ranking with both binary and graded relevance, we mainly focus on binary labels in this paper. We evaluate the proposed approach on several public LTR benchmarks and show that it consistently achieves either best or competitive result in terms of both regression and ranking metrics, and significantly improves the Pareto frontiers in the context of multi-objective optimization. Furthermore, we evaluated the proposed approach on YouTube Search and found that it not only improved the ranking quality of the production pCTR model, but also brought gains to the click prediction accuracy. The proposed approach has been successfully deployed in the YouTube production system.