论文标题
迈向安全和私人的空中联合学习
Toward Secure and Private Over-the-Air Federated Learning
论文作者
论文摘要
在本文中,研究了一个新颖的安全和私人的空中联合学习(SP-OTA-FL)框架,其中使用噪声来保护数据隐私和系统安全。具体而言,用户数据的隐私泄漏和系统的安全级别分别通过差分隐私(DP)和均方根错误安全性(MSE-SECURITY)来衡量。为了减轻噪声对学习准确性的影响,我们提出了一种通道加权后处理(CWPP)机制,该机制为较差的通道条件为设备的梯度分配了较小的重量。此外,采用CWPP可以避免总体系统的信噪比(SNR)受到该设备的限制,该设备的通道状况最差,在空中联合学习(OTA-FL)中。我们从理论上分析了噪声对隐私和安全保护的影响,并通过进行收敛分析来说明噪声对学习绩效的不利影响。基于这些分析结果,我们提出了设备调度策略,以考虑在不同的通道噪声情况下隐私和安全保护。特别是,我们制定了一个整数非线性分数编程问题,旨在最大程度地减少噪声对学习过程的负面影响。当模型具有较高的维度时,我们获得了优化问题的封闭式解决方案。对于一般情况,我们根据分支机构(BNB)方法提出了一种安全和私人算法(SPA),该方法可以获得较低的复杂性的最佳解决方案。提出的CWPP机制和设备选择策略的有效性通过模拟进行了验证。
In this paper, a novel secure and private over-the-air federated learning (SP-OTA-FL) framework is studied where noise is employed to protect data privacy and system security. Specifically, the privacy leakage of user data and the security level of the system are measured by differential privacy (DP) and mean square error security (MSE-security), respectively. To mitigate the impact of noise on learning accuracy, we propose a channel-weighted post-processing (CWPP) mechanism, which assigns a smaller weight to the gradient of the device with poor channel conditions. Furthermore, employing CWPP can avoid the issue that the signal-to-noise ratio (SNR) of the overall system is limited by the device with the worst channel condition in aligned over-the-air federated learning (OTA-FL). We theoretically analyze the effect of noise on privacy and security protection and also illustrate the adverse impact of noise on learning performance by conducting convergence analysis. Based on these analytical results, we propose device scheduling policies considering privacy and security protection in different cases of channel noise. In particular, we formulate an integer nonlinear fractional programming problem aiming to minimize the negative impact of noise on the learning process. We obtain the closed-form solution to the optimization problem when the model is with high dimension. For the general case, we propose a secure and private algorithm (SPA) based on the branch-and-bound (BnB) method, which can obtain an optimal solution with low complexity. The effectiveness of the proposed CWPP mechanism and the policies for device selection are validated through simulations.