论文标题
关于关键时期在多阶段增强学习中的重要性
On the Importance of Critical Period in Multi-stage Reinforcement Learning
论文作者
论文摘要
婴儿生命的最初几年被称为关键时期,在此期间,由于神经可塑性,学习绩效的总体发展受到显着影响。在最近的研究中,具有深层神经网络模仿实际神经元的AI代理表现出类似于人类关键时期的学习期。特别是在此初期,适当的刺激在发展学习能力中起着至关重要的作用。但是,将人类的认知偏见转变为适当的塑造奖励是非常具有挑战性的,并且在关键时期的先前工作并不集中于寻找适当的刺激。为了更进一步,我们建议多阶段的增强学习,以强调在关键时期发现``适当的刺激''。受到人类早期认知发展阶段的启发,我们在关键时期附近使用多阶段的指导,并在AI Ament的表现上表现出适当的成形奖励(阶段2指导)。
The initial years of an infant's life are known as the critical period, during which the overall development of learning performance is significantly impacted due to neural plasticity. In recent studies, an AI agent, with a deep neural network mimicking mechanisms of actual neurons, exhibited a learning period similar to human's critical period. Especially during this initial period, the appropriate stimuli play a vital role in developing learning ability. However, transforming human cognitive bias into an appropriate shaping reward is quite challenging, and prior works on critical period do not focus on finding the appropriate stimulus. To take a step further, we propose multi-stage reinforcement learning to emphasize finding ``appropriate stimulus" around the critical period. Inspired by humans' early cognitive-developmental stage, we use multi-stage guidance near the critical period, and demonstrate the appropriate shaping reward (stage-2 guidance) in terms of the AI agent's performance, efficiency, and stability.