论文标题

Musiac:具有多层控制的音乐填充应用程序的可扩展生成框架

MusIAC: An extensible generative framework for Music Infilling Applications with multi-level Control

论文作者

Guo, Rui, Simpson, Ivor, Kiefer, Chris, Magnusson, Thor, Herremans, Dorien

论文摘要

我们为音乐填充的新型音乐生成框架和用户友好的界面提供了。填充是指鉴于周围的多轨音乐的产生音乐节的任务。拟议的基于变压器的框架对于新的控制令牌是可扩展的,因为在这项工作中增加了音乐控件令牌,例如每个bar的音调张力和跟踪复音级别。我们探讨了包括几个音乐上有意义的控制令牌的效果,并使用与音高和节奏有关的客观指标评估结果。我们的结果表明,添加额外的控制令牌有助于与原始音乐具有更强的风格相似性产生音乐。与以前的研究相比,它还为用户提供了更多的控制,以更改每个条形的音乐纹理和音调张力,而该属性仅提供了轨道密度的控制。我们在Google Colab笔记本中介绍该模型,以实现交互式生成。

We present a novel music generation framework for music infilling, with a user friendly interface. Infilling refers to the task of generating musical sections given the surrounding multi-track music. The proposed transformer-based framework is extensible for new control tokens as the added music control tokens such as tonal tension per bar and track polyphony level in this work. We explore the effects of including several musically meaningful control tokens, and evaluate the results using objective metrics related to pitch and rhythm. Our results demonstrate that adding additional control tokens helps to generate music with stronger stylistic similarities to the original music. It also provides the user with more control to change properties like the music texture and tonal tension in each bar compared to previous research which only provided control for track density. We present the model in a Google Colab notebook to enable interactive generation.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源