论文标题
BIMRL:脑启发的元加强学习
BIMRL: Brain Inspired Meta Reinforcement Learning
论文作者
论文摘要
样本效率一直是加强学习(RL)的关键问题。有效的代理必须能够利用其先前的经验来快速适应类似的新任务和情况。 Meta-RL是正式化和解决此问题的一种尝试。受元RL最近进展的启发,我们介绍了BIMRL,这是一种新颖的多层建筑,以及一个新颖的脑启发记忆模块,它将帮助代理商在几集中迅速适应新任务。我们还利用此内存模块来设计一种新颖的内在奖励,以指导代理商的探索。我们的架构灵感来自认知神经科学的发现,并且与大脑不同区域的连通性和功能的知识兼容。我们通过与在多个Minigrid环境中竞争或超过某些强基础的性能,从经验上验证了我们提出的方法的有效性。
Sample efficiency has been a key issue in reinforcement learning (RL). An efficient agent must be able to leverage its prior experiences to quickly adapt to similar, but new tasks and situations. Meta-RL is one attempt at formalizing and addressing this issue. Inspired by recent progress in meta-RL, we introduce BIMRL, a novel multi-layer architecture along with a novel brain-inspired memory module that will help agents quickly adapt to new tasks within a few episodes. We also utilize this memory module to design a novel intrinsic reward that will guide the agent's exploration. Our architecture is inspired by findings in cognitive neuroscience and is compatible with the knowledge on connectivity and functionality of different regions in the brain. We empirically validate the effectiveness of our proposed method by competing with or surpassing the performance of some strong baselines on multiple MiniGrid environments.