论文标题
线性模型中的彩票:迭代幅度修剪的分析
Lottery Tickets in Linear Models: An Analysis of Iterative Magnitude Pruning
论文作者
论文摘要
我们分析了彩票票证假设ARXIV背后的修剪程序:1803.03635v5,迭代幅度修剪(IMP),当应用于通过梯度流训练的线性模型。我们首先在特征的统计结构上介绍足够的条件,而这些特征的统计结构将IMP预测在数据上具有最小投影的特征。在此之后,我们探索IMP作为稀疏估计方法。
We analyse the pruning procedure behind the lottery ticket hypothesis arXiv:1803.03635v5, iterative magnitude pruning (IMP), when applied to linear models trained by gradient flow. We begin by presenting sufficient conditions on the statistical structure of the features under which IMP prunes those features that have smallest projection onto the data. Following this, we explore IMP as a method for sparse estimation.