Modeling Temporal Dependencies in High-Dimensional Sequences: Application to Polyphonic Music Generation and Transcription

27 Jun 2012  ·  Nicolas Boulanger-Lewandowski, Yoshua Bengio, Pascal Vincent ·

We investigate the problem of modeling symbolic sequences of polyphonic music in a completely general piano-roll representation. We introduce a probabilistic model based on distribution estimators conditioned on a recurrent neural network that is able to discover temporal dependencies in high-dimensional sequences. Our approach outperforms many traditional models of polyphonic music on a variety of realistic datasets. We show how our musical language model can serve as a symbolic prior to improve the accuracy of polyphonic transcription.

PDF Abstract

Datasets


Introduced in the Paper:

JSB Chorales MuseData

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Music Modeling JSB Chorales RNN-RBM NLL 6.27 # 6
Music Modeling JSB Chorales RNN-NADE NLL 5.56 # 5

Methods


No methods listed for this paper. Add relevant methods here