论文标题

线性模型中的彩票:迭代幅度修剪的分析

Lottery Tickets in Linear Models: An Analysis of Iterative Magnitude Pruning

论文作者

Elesedy, Bryn, Kanade, Varun, Teh, Yee Whye

论文摘要

我们分析了彩票票证假设ARXIV背后的修剪程序:1803.03635v5,迭代幅度修剪(IMP),当应用于通过梯度流训练的线性模型。我们首先在特征的统计结构上介绍足够的条件,而这些特征的统计结构将IMP预测在数据上具有最小投影的特征。在此之后,我们探索IMP作为稀疏估计方法。

We analyse the pruning procedure behind the lottery ticket hypothesis arXiv:1803.03635v5, iterative magnitude pruning (IMP), when applied to linear models trained by gradient flow. We begin by presenting sufficient conditions on the statistical structure of the features under which IMP prunes those features that have smallest projection onto the data. Following this, we explore IMP as a method for sparse estimation.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源