论文标题

网络加速分布式文件系统的构建块

Building Blocks for Network-Accelerated Distributed File Systems

论文作者

Di Girolamo, Salvatore, De Sensi, Daniele, Taranov, Konstantin, Malesevic, Milos, Besta, Maciej, Schneider, Timo, Kistler, Severin, Hoefler, Torsten

论文摘要

高性能集群和数据中心对存储系统提出了越来越多的要求。如果这些系统不进行大规模运行,则注定要成为I/O的应用和浪费计算周期。为了加速到达远程存储节点的数据路径,存储系统已经接受了远程直接内存访问(RDMA),以使数据从网络流向存储目标,从而减少了整体延迟和CPU利用率。但是,这种方法仍然涉及在数据路径上执行存储策略(例如身份验证,复制和擦除编码)的CPU。我们展示了如何在不涉及主机CPU的情况下将存储策略卸载到完全可编程的智能机构中。通过使用PSPIN(一种开放型智能软件),我们显示了与基于CPU和RDMA的替代方案相比,使用撰写(最多2倍),数据复制(最高2倍)和擦除编码(最高2倍)(最高2倍)。

High-performance clusters and datacenters pose increasingly demanding requirements on storage systems. If these systems do not operate at scale, applications are doomed to become I/O bound and waste compute cycles. To accelerate the data path to remote storage nodes, remote direct memory access (RDMA) has been embraced by storage systems to let data flow from the network to storage targets, reducing overall latency and CPU utilization. Yet, this approach still involves CPUs on the data path to enforce storage policies such as authentication, replication, and erasure coding. We show how storage policies can be offloaded to fully programmable SmartNICs, without involving host CPUs. By using PsPIN, an open-hardware SmartNIC, we show latency improvements for writes (up to 2x), data replication (up to 2x), and erasure coding (up to 2x), when compared to respective CPU- and RDMA-based alternatives.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源