论文标题
竞争结果的基于投资组合的分析方法
A portfolio-based analysis method for competition results
论文作者
论文摘要
诸如微型挑战或SAT比赛之类的比赛对于比较不同解决方法的性能并推进了领域的最先进的竞争来源。传统的竞争环境通常集中在求解器之间根据其在广泛的基准问题和实例中的平均性能在求解器之间产生排名。尽管这是评估求解器相对性能的明智方法，但这种排名并不一定反映了求解器的全部潜力，尤其是当我们想利用求解器组合而不是单个求解器来解决新问题时。在本文中，我将描述一种基于投资组合的分析方法，该方法可以提供互补的见解，以了解参与竞争者的表现。该方法证明了微小挑战的结果，并从投资组合观点获得了新的见解。
Competitions such as the MiniZinc Challenges or the SAT competitions have been very useful sources for comparing performance of different solving approaches and for advancing the state-of-the-arts of the fields. Traditional competition setting often focuses on producing a ranking between solvers based on their average performance across a wide range of benchmark problems and instances. While this is a sensible way to assess the relative performance of solvers, such ranking does not necessarily reflect the full potential of a solver, especially when we want to utilise a portfolio of solvers instead of a single one for solving a new problem. In this paper, I will describe a portfolio-based analysis method which can give complementary insights into the performance of participating solvers in a competition. The method is demonstrated on the results of the MiniZinc Challenges and new insights gained from the portfolio viewpoint are presented.
