论文标题

使用赫尔库勒(Hercule)提高E/O的I/O和可视化

Boosting I/O and visualization for exascale era using Hercule: test case on RAMSES

论文作者

Strafella, Loic, Chapon, Damien

论文摘要

已经清楚地发现,I/O是扩展Exascale时代应用程序的瓶颈之一。诸如“在运输中”和“原位”可视化和分析之类的新概念已被确定为绕过这一特定问题的关键技术。在CEA-DAM开发的一个新的并行I/O和数据管理库已集成到Ramses,Ramses是一种自我磨削流体的AMR仿真代码。将原始的Ramses输出格式分解为专门针对检查点/重新启动(HPROT格式)或后处理(HDEP格式)的原始Ramses输出格式(HDEP格式)不仅提高了RAMSES代码的I/O性能和可扩展性,还可以在模拟输出中引入更大的灵活性,以帮助他们的DMP(数据管理平面图)。此外,非常轻巧和特定目的的后处理格式(HDEP)将显着改善分析和可视化工具(例如Pymes 5)的总体性能。将讨论Hercule Parallel I/O库以及I/O基准结果的简介。

It has been clearly identified that I/O is one of the bottleneck to extend application for the exascale era. New concepts such as 'in transit' and 'in situ' visualization and analysis have been identified as key technologies to circumvent this particular issue. A new parallel I/O and data management library called Hercule, developed at CEA-DAM, has been integrated to Ramses, an AMR simulation code for self-gravitating fluids. Splitting the original Ramses output format in Hercule database formats dedicated to either checkpoints/restarts (HProt format) or post-processing (HDep format) not only improved I/O performance and scalability of the Ramses code but also introduced much more flexibility in the simulation outputs to help astrophysicists prepare their DMP (Data Management Plan). Furthermore, the very lightweight and purpose-specific post-processing format (HDep) will significantly improve the overall performance of analysis and visualization tools such as PyMSES 5. An introduction to the Hercule parallel I/O library as well as I/O benchmark results will be discussed.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源