论文标题

多元化审稿人建议扩展会议计划委员会

Diverse Reviewer Suggestion for Extending Conference Program Committees

论文作者

Kreutz, Christin Katharina, Balog, Krisztian, Schenkel, Ralf

论文摘要

自动审稿人对科学会议的建议目前依赖于计划委员会具有必要的专业知识来处理所有提交的假设。但是,收到的意见书和审稿人候选人之间的局部差异可能会导致不可靠的审查或对审稿人的负担过高,并且可能导致拒绝高质量的论文。在这项工作中,我们提出了潜水员,这是一种可解释的基于流的审阅者分配方法,该方法自动生成审阅者的作业,并提出了与新审稿人候选人扩展当前计划委员会的建议。我们的算法着重于分配给论文的一组审阅者的多样性,这些审核者在先前的工作中大多被忽略了。具体而言,我们考虑了专业背景,位置和资历的多样性。我们使用两个现实世界会议数据集进行评估,我们表明,与真实任务和最先进的基于流程的审阅者分配方法相比,潜水员可以改善多样性。此外,根据以前的PC椅子的人类评估,我们发现潜水员可以有效地权衡一些主题适用性,以构建更多样化的审阅者作业。

Automated reviewer recommendation for scientific conferences currently relies on the assumption that the program committee has the necessary expertise to handle all submissions. However, topical discrepancies between received submissions and reviewer candidates might lead to unreliable reviews or overburdening of reviewers, and may result in the rejection of high-quality papers. In this work, we present DiveRS, an explainable flow-based reviewer assignment approach, which automatically generates reviewer assignments as well as suggestions for extending the current program committee with new reviewer candidates. Our algorithm focuses on the diversity of the set of reviewers assigned to papers, which has been mostly disregarded in prior work. Specifically, we consider diversity in terms of professional background, location and seniority. Using two real world conference datasets for evaluation, we show that DiveRS improves diversity compared to both real assignments and a state-of-the-art flow-based reviewer assignment approach. Further, based on human assessments by former PC chairs, we find that DiveRS can effectively trade off some of the topical suitability in order to construct more diverse reviewer assignments.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源