论文标题
让我们谈谈!通过对话视觉问题产生进行对话
Let's Talk! Striking Up Conversations via Conversational Visual Question Generation
论文作者
论文摘要
一个引人入胜且挑衅的问题可以打开一个很好的对话。在这项工作中,我们探讨了一种新颖的方案:对话代理人可以查看用户照片的一组(例如,从社交媒体平台上),并提出一个引人入胜的问题以启动与用户的对话。现有的构想对象模型主要产生乏味而明显的问题,这可能不是理想的对话开始者。本文介绍了一个两阶段的框架,该框架首先为照片集生成视觉故事,然后使用故事来提出一个有趣的问题。人类评估表明,与其他愿景对问题基线相比,我们的框架为开始对话产生了更多的发动响应问题。
An engaging and provocative question can open up a great conversation. In this work, we explore a novel scenario: a conversation agent views a set of the user's photos (for example, from social media platforms) and asks an engaging question to initiate a conversation with the user. The existing vision-to-question models mostly generate tedious and obvious questions, which might not be ideals conversation starters. This paper introduces a two-phase framework that first generates a visual story for the photo set and then uses the story to produce an interesting question. The human evaluation shows that our framework generates more response-provoking questions for starting conversations than other vision-to-question baselines.