论文标题

分配分辨率的分布式计算

Distributed Computations with Layered Resolution

论文作者

Esfahanizadeh, Homa, Cohen, Alejandro, Médard, Muriel, Shamai, Shlomo

论文摘要

现代计算中的应用通常是时间敏感的,需要分布式策略来加速它们。另一方面,分布式计算在实践中遭受了缓慢工人的瓶颈。分布式编码计算是一种有吸引力的解决方案,可添加冗余,因此分布式计算的子集足以获得最终结果。但是,最终结果要么在期望的时间内是否在未达到的时间内获得,因此,对于后者来说,所花费的资源浪费了。在本文中,我们介绍了分层分布的编码计算的新颖概念,以使最终结果的分辨率较低,这是从工人的集体结果中获得的 - 比最终结果更早。这项创新使得拥有更有效的基于截止日期的系统成为可能,因为即使计算作业因时间安排而被终止,也可以发布最终结果的近似版本。基于我们的理论和经验结果,第一分辨率的平均执行延迟明显小于最终分辨率的平均执行延迟。此外,在最终决议几乎一直超过截止日期的环境中,截止日期的可能性是第一个决议的概率,从而降低了系统的成功率而没有分层。

Modern computationally-heavy applications are often time-sensitive, demanding distributed strategies to accelerate them. On the other hand, distributed computing suffers from the bottleneck of slow workers in practice. Distributed coded computing is an attractive solution that adds redundancy such that a subset of distributed computations suffices to obtain the final result. However, the final result is still either obtained within a desired time or not, and for the latter, the resources that are spent are wasted. In this paper, we introduce the novel concept of layered-resolution distributed coded computations such that lower resolutions of the final result are obtained from collective results of the workers -- at an earlier stage than the final result. This innovation makes it possible to have more effective deadline-based systems, since even if a computational job is terminated because of timing, an approximated version of the final result can be released. Based on our theoretical and empirical results, the average execution delay for the first resolution is notably smaller than the one for the final resolution. Moreover, the probability of meeting a deadline is one for the first resolution in a setting where the final resolution exceeds the deadline almost all the time, reducing the success rate of the systems with no layering.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源