论文标题
使用低维观测过滤器进行视觉复杂视频游戏的深度加固学习
Deep Reinforcement Learning Using a Low-Dimensional Observation Filter for Visual Complex Video Game Playing
论文作者
论文摘要
自提出以来,深度加强学习(DRL)已取得了巨大的成就,包括处理原始视觉输入数据的可能性。但是,培训代理根据图像反馈执行任务仍然是一个挑战。它需要从框架上处理大量数据,并根据端到端的深神经网络策略计算代理的动作。图像预处理是减少这些高维空间的有效方法,消除了场景中存在的不必要信息,从而支持特征的提取及其在代理的神经网络中的表示。现代视频游戏是DRL算法的这种挑战的示例,因为它们的视觉复杂性。在本文中,我们提出了一个低维观测过滤器,该过滤器允许深Q-Network代理在视觉复杂且现代的视频游戏中成功播放,称为Neon Drive。
Deep Reinforcement Learning (DRL) has produced great achievements since it was proposed, including the possibility of processing raw vision input data. However, training an agent to perform tasks based on image feedback remains a challenge. It requires the processing of large amounts of data from high-dimensional observation spaces, frame by frame, and the agent's actions are computed according to deep neural network policies, end-to-end. Image pre-processing is an effective way of reducing these high dimensional spaces, eliminating unnecessary information present in the scene, supporting the extraction of features and their representations in the agent's neural network. Modern video-games are examples of this type of challenge for DRL algorithms because of their visual complexity. In this paper, we propose a low-dimensional observation filter that allows a deep Q-network agent to successfully play in a visually complex and modern video-game, called Neon Drive.