论文标题
部分可观测时空混沌系统的无模型预测
Adaptive Distribution Calibration for Few-Shot Learning with Hierarchical Optimal Transport
论文作者
论文摘要
很少有射击分类旨在学习分类器,以识别培训期间看不见的课程,在这种培训中,基于仅少数培训示例所形成的有偏见分布,学到的模型可以轻松地变得过于拟合。解决此问题的最新解决方案是通过以足够的示例从基类传输统计数据来校准这几个样本类别的分布,其中如何确定从基类到新颖类的转移权重是关键。但是,尚未仔细研究用于学习转移权重的原则方法。为此,我们通过学习新样本和基类之间的自适应重量矩阵提出了一种新颖的分布校准方法,该方法建立在层次最佳传输(H-OT)框架上。通过最大程度地减少新样本和基类之间的高级OT距离,我们可以将学习的运输计划视为传递基类统计数据的自适应权重信息。在高级OT中,基础类别和新颖类之间的成本函数的学习导致了低级OT的引入,这考虑了基类中所有数据样本的权重。标准基准测试的实验结果表明,我们提出的即插即用模型优于竞争方法,并且拥有所需的跨域泛化能力,这表明学到的自适应权重的有效性。
Few-shot classification aims to learn a classifier to recognize unseen classes during training, where the learned model can easily become over-fitted based on the biased distribution formed by only a few training examples. A recent solution to this problem is calibrating the distribution of these few sample classes by transferring statistics from the base classes with sufficient examples, where how to decide the transfer weights from base classes to novel classes is the key. However, principled approaches for learning the transfer weights have not been carefully studied. To this end, we propose a novel distribution calibration method by learning the adaptive weight matrix between novel samples and base classes, which is built upon a hierarchical Optimal Transport (H-OT) framework. By minimizing the high-level OT distance between novel samples and base classes, we can view the learned transport plan as the adaptive weight information for transferring the statistics of base classes. The learning of the cost function between a base class and novel class in the high-level OT leads to the introduction of the low-level OT, which considers the weights of all the data samples in the base class. Experimental results on standard benchmarks demonstrate that our proposed plug-and-play model outperforms competing approaches and owns desired cross-domain generalization ability, indicating the effectiveness of the learned adaptive weights.