论文标题
关于视觉和语言方式行动的推理：调查
Reasoning about Actions over Visual and Linguistic Modalities: A Survey
论文作者
论文摘要
“行动”在人类与世界互动并使他们达到理想的目标方面起着至关重要的作用。结果，人类的最常识（CS）知识围绕着行动。尽管“关于行动与变革的推理”（RAC）在知识代表社区中进行了广泛的研究，但它最近引起了NLP和计算机视觉研究人员的兴趣。本文调查了现有的任务，基准数据集，各种技术和模型，以及它们在视觉和语言领域中RAC中进步的各自绩效。最后，我们总结了我们的关键要点，讨论该研究领域面临的目前挑战，并概述了未来研究的潜在方向。
'Actions' play a vital role in how humans interact with the world and enable them to achieve desired goals. As a result, most common sense (CS) knowledge for humans revolves around actions. While 'Reasoning about Actions & Change' (RAC) has been widely studied in the Knowledge Representation community, it has recently piqued the interest of NLP and computer vision researchers. This paper surveys existing tasks, benchmark datasets, various techniques and models, and their respective performance concerning advancements in RAC in the vision and language domain. Towards the end, we summarize our key takeaways, discuss the present challenges facing this research area, and outline potential directions for future research.
