论文标题

在动态任务中探索权衡取舍,触发松散耦合的科学工作流程

Exploring Trade-offs in Dynamic Task Triggering for Loosely Coupled Scientific Workflows

论文作者

Wang, Zhe, Subedi, Pradeep, Duan, Shaohua, Qin, Yubo, Davis, Philip, Simonet, Anthony, Rodero, Ivan, Parashar, Manish

论文摘要

为了获得近时间的见解,科学工作流程往往以灵活而动态的方式组织。数据驱动的任务触发已被探讨,作为支持基于数据发展的工作流程的一种方式。但是,通过这种动态触发任务引入的开销是一个研究不足的主题。本文讨论了动态任务触发器的不同方面。特别是,我们探索构建数据驱动的动态工作流程,然后评估此类设计决策引入的间接费用的不同方法。我们评估工作流的数据大小,有趣的数据百分比,时间数据分布以及触发的任务数量。最后,我们根据对希望构建数据驱动科学工作流程的用户的评估结果分析提供建议。

In order to achieve near-time insights, scientific workflows tend to be organized in a flexible and dynamic way. Data-driven triggering of tasks has been explored as a way to support workflows that evolve based on the data. However, the overhead introduced by such dynamic triggering of tasks is an under-studied topic. This paper discusses different facets of dynamic task triggers. Particularly, we explore different ways of constructing a data-driven dynamic workflow and then evaluate the overheads introduced by such design decisions. We evaluate workflows with varying data size, percentage of interesting data, temporal data distribution, and number of tasks triggered. Finally, we provide advice based upon analysis of the evaluation results for users looking to construct data-driven scientific workflows.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源