论文标题
开源缺陷注入基准测试床用于评估测试
Open-source Defect Injection Benchmark Testbed for the Evaluation of Testing
论文作者
论文摘要
评估测试技术有效性的一种自然方法是在应用创建的测试用例时测量缺陷检测率。在这里，可以将真实软件缺陷注入软件的源代码中。为了进行更广泛的评估，通常需要注射人造缺陷，可以通过使用密码突变算子进行突变测试进行。但是，为了模拟因设计规范的误解而引起的复杂缺陷，在某些情况下，突变测试可能会达到极限。在本文中，我们提出了一种开源基准测试式应用程序，该应用采用了人工缺陷注入的补充方法。在从预定义的构建块中注入人造缺陷后，该应用程序是在将人造缺陷注入其源代码之后的。大多数功能和用户界面元素都通过创建可以在实验中使用的前端自动测试用例来涵盖。
A natural method to evaluate the effectiveness of a testing technique is to measure the defect detection rate when applying the created test cases. Here, real or artificial software defects can be injected into the source code of software. For a more extensive evaluation, the injection of artificial defects is usually needed and can be performed via mutation testing using code mutation operators. However, to simulate complex defects arising from a misunderstanding of design specifications, mutation testing might reach its limit in some cases. In this paper, we present an open-source benchmark testbed application that employs a complement method of artificial defect injection. The application is compiled after artificial defects are injected into its source code from predefined building blocks. The majority of the functions and user interface elements are covered by creating front-end-based automated test cases that can be used in experiments.
