论文标题
数据驱动的紧急HPC的定制工作流管理系统
A Bespoke Workflow Management System for Data-Driven Urgent HPC
论文作者
论文摘要
在本文中，我们提出了一个工作流管理系统，该系统允许紧急计算所需的数据驱动的工作流程，即随着灾难的进行，将新数据集成到工作流程中，以便随着时间的推移来完善预测。这允许工作流程在运行时适应新数据，这是大多数工作流管理系统所不具备的功能。工作流管理系统是为欧盟资助的Vestec项目开发的，该项目旨在将HPC与实时数据融合，以支持紧急决策。我们首先描述了Vestec项目的示例工作流程，并展示了为什么现有的工作流技术不满足项目的需求。然后，我们继续介绍我们的工作流管理系统的设计，描述如何将其实现到Vestec系统中，并提供用于测试案例的工作流系统的示例。
In this paper we present a workflow management system which permits the kinds of data-driven workflows required by urgent computing, namely where new data is integrated into the workflow as a disaster progresses in order refine the predictions as time goes on. This allows the workflow to adapt to new data at runtime, a capability that most workflow management systems do not possess. The workflow management system was developed for the EU-funded VESTEC project, which aims to fuse HPC with real-time data for supporting urgent decision making. We first describe an example workflow from the VESTEC project, and show why existing workflow technologies do not meet the needs of the project. We then go on to present the design of our Workflow Management System, describe how it is implemented into the VESTEC system, and provide an example of the workflow system in use for a test case.
