0


小冰乐队:流行音乐的旋律和编曲生成框架

XiaoIce Band: A Melody and Arrangement Generation Framework for Pop Music
课程网址: http://videolectures.net/kdd2018_zhu_pop_music/  
主讲教师: Hongyuan Zhu
开课单位: 中国科学技术大学
开课时间: 2018-11-23
课程语种: 英语
中文简介:
随着音乐创作知识的发展和最近需求的增加,越来越多的公司和研究机构开始研究音乐的自动生成。然而,以前的模型在应用于歌曲生成时有局限性,这需要旋律和编曲。此外,许多与歌曲质量相关的关键因素,如和弦进行和节奏模式,都没有得到很好的解决。特别是,如何确保多音轨音乐的和谐问题仍然没有得到充分的探索。为此,我们对流行音乐的生成进行了重点研究,同时考虑了旋律生成对和弦和节奏的影响以及音乐编排的和谐性。我们提出了一个端到端的旋律和编曲生成框架,称为小冰乐队,它生成一个旋律音轨,由几种类型的乐器演奏几个伴奏音轨。具体来说,我们设计了一个基于和弦的节奏和旋律交叉生成模型(CRMCG)来生成具有和弦进行的旋律。然后,我们提出了一种使用多任务学习进行多音轨音乐编排的多乐器协同编排模型(MICA)。最后,我们在真实世界的数据集上进行了广泛的实验,结果证明了小冰带的有效性。
课程简介: With the development of knowledge of music composition and the recent increase in demand, an increasing number of companies and research institutes have begun to study the automatic generation of music. However, previous models have limitations when applying to song generation, which requires both the melody and arrangement. Besides, many critical factors related to the quality of a song such as chord progression and rhythm patterns are not well addressed. In particular, the problem of how to ensure the harmony of multi-track music is still underexplored. To this end, we present a focused study on pop music generation, in which we take both chord and rhythm influence of melody generation and the harmony of music arrangement into consideration. We propose an end-to-end melody and arrangement generation framework, called XiaoIce Band, which generates a melody track with several accompany tracks played by several types of instruments. Specifically, we devise a Chord based Rhythm and Melody Cross-Generation Model (CRMCG) to generate melody with chord progressions. Then, we propose a Multi-Instrument Co-Arrangement Model (MICA) using multi-task learning for multi-track music arrangement. Finally, we conduct extensive experiments on a real-world dataset, where the results demonstrate the effectiveness of XiaoIce Band.
关 键 词: 小冰乐队; 流行音乐的旋律; 编曲生成框架; 旋律交叉生成模型
课程来源: 视频讲座网
数据采集: 2023-03-23:cyh
最后编审: 2023-05-17:liyy
阅读次数: 28