论文标题
Sonus Texere！使用电影改编的书籍的自动密集配乐构造
Sonus Texere! Automated Dense Soundtrack Construction for Books using Movie Adaptations
论文作者
论文摘要
阅读就像音乐听一样，是一种沉浸式的体验，可以将读者带入情感旅程的同时。聆听互补的音乐有可能放大阅读体验，尤其是当音乐在风格上具有凝聚力和情感上的相关性时。在本文中，我们提出了第一种全自动方法来构建书籍密集的配乐，该原声带可以在整个阅读期间播放高质量的乐器音乐。我们的作品采用了独特的文本处理和音乐编织管道，该管道决定了一章中场景的上下文和情感组成。这使我们的方法可以从本书的电影改编的配乐中识别和播放相关摘录。通过依靠电影作曲家的工艺，我们的书配乐包括专家制作的图案和其他特定场景的音乐特征。我们通过感知研究来验证方法的设计决策。我们的读者指出，这本书的配乐大大增强了他们的阅读体验，这是由于通过不间断和风格的音乐赋予了高度沉浸感，并且通过高精度的情感和场景上下文识别获得的情感状态增强。
Reading, much like music listening, is an immersive experience that transports readers while taking them on an emotional journey. Listening to complementary music has the potential to amplify the reading experience, especially when the music is stylistically cohesive and emotionally relevant. In this paper, we propose the first fully automatic method to build a dense soundtrack for books, which can play high-quality instrumental music for the entirety of the reading duration. Our work employs a unique text processing and music weaving pipeline that determines the context and emotional composition of scenes in a chapter. This allows our method to identify and play relevant excerpts from the soundtrack of the book's movie adaptation. By relying on the movie composer's craftsmanship, our book soundtracks include expert-made motifs and other scene-specific musical characteristics. We validate the design decisions of our approach through a perceptual study. Our readers note that the book soundtrack greatly enhanced their reading experience, due to high immersiveness granted via uninterrupted and style-consistent music, and a heightened emotional state attained via high precision emotion and scene context recognition.
