论文标题

基于模块化的转运等级框架

Modularized Transfomer-based Ranking Framework

论文作者

Gao, Luyu, Dai, Zhuyun, Callan, Jamie

论文摘要

基于变压器的排名模型的最新创新已推动了信息检索的最新创新。但是,这些变压器在计算上很昂贵,其不透明的隐藏状态使得很难理解排名过程。在这项工作中,我们将变压器排名模块化为单独的模块,以进行文本表示和交互。我们展示了该设计如何使用离线预计表示和轻巧的在线互动实现更快的排名。模块化设计也更容易解释,并阐明了变压器排名中的排名过程。

Recent innovations in Transformer-based ranking models have advanced the state-of-the-art in information retrieval. However, these Transformers are computationally expensive, and their opaque hidden states make it hard to understand the ranking process. In this work, we modularize the Transformer ranker into separate modules for text representation and interaction. We show how this design enables substantially faster ranking using offline pre-computed representations and light-weight online interactions. The modular design is also easier to interpret and sheds light on the ranking process in Transformer rankers.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源