论文标题

BlockDFL:基于区块链的完全分散的对等人联盟的学习框架

BlockDFL: A Blockchain-based Fully Decentralized Peer-to-Peer Federated Learning Framework

论文作者

Qin, Zhen, Yan, Xueqiang, Zhou, Mengchu, Deng, Shuiguang

论文摘要

联合学习(FL)可以在无需共享培训数据的情况下对机器学习模型进行协作培训。传统的FL在很大程度上依赖于受信任的集中服务器。尽管分散的FL消除了中心依赖性,但由于对参与者行为的限制不足以及繁重的沟通成本,尤其是在完全分散的场景中,即在完全分散的方案,即对点对点(P2P)设置,因此可能会使FL所面临的另一个继承问题(例如中毒攻击和数据表示泄漏)泄漏。在本文中,我们为FL(称为BlockDFL)提出了一个基于区块链的完全分散的P2P框架。它需要区块链为基础,利用拟议的基于PBFT的投票机制和两层评分机制来协调同伴参与者而无需相互信任的同伴参与者,同时有效地捍卫了中毒攻击。引入梯度压缩以降低通信成本,并防止数据从传输模型更新中重建。在两个现实世界数据集上进行的广泛实验展示了BlockDFL与集中式FL相比获得竞争精度,并且可以捍卫中毒攻击,同时实现效率和可伸缩性。尤其是当恶意参与者的比例高达40%时,BlockDFL仍然可以保留FL的准确性,从而优于基于区块链的现有完全分散的P2P FL框架。

Federated learning (FL) enables collaborative training of machine learning models without sharing training data. Traditional FL heavily relies on a trusted centralized server. Although decentralized FL eliminates the central dependence, it may worsen the other inherit problems faced by FL such as poisoning attacks and data representation leakage due to insufficient restrictions on the behavior of participants, and heavy communication cost, especially in fully decentralized scenarios, i.e., peer-to-peer (P2P) settings. In this paper, we propose a blockchain-based fully decentralized P2P framework for FL, called BlockDFL. It takes blockchain as the foundation, leveraging the proposed PBFT-based voting mechanism and two-layer scoring mechanism to coordinate FL among peer participants without mutual trust, while effectively defending against poisoning attacks. Gradient compression is introduced to lowering communication cost and prevent data from being reconstructed from transmitted model updates. Extensive experiments conducted on two real-world datasets exhibit that BlockDFL obtains competitive accuracy compared to centralized FL and can defend poisoning attacks while achieving efficiency and scalability. Especially when the proportion of malicious participants is as high as 40%, BlockDFL can still preserve the accuracy of FL, outperforming existing fully decentralized P2P FL frameworks based on blockchain.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源