论文标题

用有限的样本学习 - 元学习和通信系统的应用

Learning with Limited Samples -- Meta-Learning and Applications to Communication Systems

论文作者

Chen, Lisha, Jose, Sharu Theresa, Nikoloska, Ivana, Park, Sangwoo, Chen, Tianyi, Simeone, Osvaldo

论文摘要

深度学习在许多机器学习任务中取得了巨大的成功,例如图像分类,语音识别和游戏玩法。但是,这些突破通常很难转化为现实世界的工程系统,因为深度学习模型需要大量的培训样本,这在实践中是昂贵的。为了解决标记的数据稀缺性,很少有元学习优化可以有效地适应新任务的学习算法。尽管元学习对机器学习文献引起了重大兴趣,但其工作原理和理论基础知识在工程界尚未充分了解。 这本综述专着通过涵盖原理,算法,理论和工程应用来介绍元学习。在与常规学习和联合学习相比引入元学习之后,我们描述了主要的元学习算法,以及用于定义元学习技术的一般二聚体优化框架。然后,我们从统计学习观点总结了元学习的概括能力的已知结果。接下来将讨论通信系统中的应用程序,包括解码和功率分配,然后对与元学习与新兴计算技术的整合有关的方面进行了简介,即神经态和量子计算。该专着的结论是开放研究挑战的概述。

Deep learning has achieved remarkable success in many machine learning tasks such as image classification, speech recognition, and game playing. However, these breakthroughs are often difficult to translate into real-world engineering systems because deep learning models require a massive number of training samples, which are costly to obtain in practice. To address labeled data scarcity, few-shot meta-learning optimizes learning algorithms that can efficiently adapt to new tasks quickly. While meta-learning is gaining significant interest in the machine learning literature, its working principles and theoretic fundamentals are not as well understood in the engineering community. This review monograph provides an introduction to meta-learning by covering principles, algorithms, theory, and engineering applications. After introducing meta-learning in comparison with conventional and joint learning, we describe the main meta-learning algorithms, as well as a general bilevel optimization framework for the definition of meta-learning techniques. Then, we summarize known results on the generalization capabilities of meta-learning from a statistical learning viewpoint. Applications to communication systems, including decoding and power allocation, are discussed next, followed by an introduction to aspects related to the integration of meta-learning with emerging computing technologies, namely neuromorphic and quantum computing. The monograph is concluded with an overview of open research challenges.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源