5 ms·

DeepJ: Style-Specific Music Generation

76 points by lainon 9y ago

lainon 9y ago
paper: https://arxiv.org/abs/1801.00887 https://arxiv.org/abs/1801.00887
anonfunction 9y ago
This project would really benefit from some examples.
- ibrault 9y ago
  Agreed, not really sure what the point of the website is if it's just some sliders with nothing actually playing.
  - p1esk 9y ago
    https://github.com/calclavia/DeepJ/tree/icsc/archives/v1 https://github.com/calclavia/DeepJ/tree/icsc/archives/v1
    - radarsat1 9y ago
      These sound pretty awful, frankly.
nicolashahn 9y ago
`requirements.txt` has a linux only wheel - any help on getting it running with OSX?
- p1esk 9y ago
  Just install pytorch.
dimmuborgir 9y ago
Same old story. Short incoherent melodies scattered everywhere with no structure whatsoever.
- bitL 9y ago
  Next step will be to clone ranking from some well-known music critics which would actually make it work this time. Behavioral cloning is now used heavily in computer vision, haven't seen it used in music generation yet, but I expect it to be groundbreaking as algorithm would be able to discern certain qualities that pure generating sequences won't.
- meggar 9y ago
  That describes 90% of jazz too.
  - olegkikin 9y ago
    And 100% of glitch music.
stevehiehn 9y ago
In terms of melodies I think trainning off lead-sheets is far better than raw midi. The reason being is when humans generate melodies they can anticipate implied harmonic structure. i.e.Chords. You folks might be interested in a leadsheet dataset i'm creating for the purpose of generating melodies: https://github.com/shiehn/chord-melody-dataset https://github.com/shiehn/chord-melody-dataset
- p1esk 9y ago
  Lead sheets are only suitable for songs though. This work focuses on more complex/polyphonic music.
  - stevehiehn 9y ago
    Ah ok, I really just made an assumption that the goal is to generate convincing harmonic music. In this case after spending a couple years fighting with that problem I've been reaching a conclusion that the chords and melody are absolutely by far the most difficult & 'human' aspect where as counter-point/polyphony are actually very mechanical & really just support the chord/melody structure. Recently I've been having very good results by first generating chords/melody with RNN's then having subsequent processes generate supporting harmonies.
    - p1esk 9y ago
      Can you show us some of those good results?
      - stevehiehn 9y ago
        These are results from starting with just a chord progression & stacking ontop of it: http://signalsandsorcery.com http://signalsandsorcery.com About 5 months ago I decided to pivot & start with a melody & chords. I have not yet stood up the system that starts with chords & melody. So the answer is not yet.
        9y ago
deleted 9y ago
[deleted]

76 points by lainon 9y ago

lainon 9y ago

paper: https://arxiv.org/abs/1801.00887 https://arxiv.org/abs/1801.00887

anonfunction 9y ago

This project would really benefit from some examples.

ibrault 9y ago
Agreed, not really sure what the point of the website is if it's just some sliders with nothing actually playing.
- p1esk 9y ago
  https://github.com/calclavia/DeepJ/tree/icsc/archives/v1 https://github.com/calclavia/DeepJ/tree/icsc/archives/v1
  - radarsat1 9y ago
    These sound pretty awful, frankly.

nicolashahn 9y ago

`requirements.txt` has a linux only wheel - any help on getting it running with OSX?

p1esk 9y ago
Just install pytorch.

dimmuborgir 9y ago

Same old story. Short incoherent melodies scattered everywhere with no structure whatsoever.

bitL 9y ago
Next step will be to clone ranking from some well-known music critics which would actually make it work this time. Behavioral cloning is now used heavily in computer vision, haven't seen it used in music generation yet, but I expect it to be groundbreaking as algorithm would be able to discern certain qualities that pure generating sequences won't.
meggar 9y ago
That describes 90% of jazz too.
- olegkikin 9y ago
  And 100% of glitch music.

stevehiehn 9y ago

In terms of melodies I think trainning off lead-sheets is far better than raw midi. The reason being is when humans generate melodies they can anticipate implied harmonic structure. i.e.Chords. You folks might be interested in a leadsheet dataset i'm creating for the purpose of generating melodies: https://github.com/shiehn/chord-melody-dataset https://github.com/shiehn/chord-melody-dataset

p1esk 9y ago
Lead sheets are only suitable for songs though. This work focuses on more complex/polyphonic music.
- stevehiehn 9y ago
  Ah ok, I really just made an assumption that the goal is to generate convincing harmonic music. In this case after spending a couple years fighting with that problem I've been reaching a conclusion that the chords and melody are absolutely by far the most difficult & 'human' aspect where as counter-point/polyphony are actually very mechanical & really just support the chord/melody structure. Recently I've been having very good results by first generating chords/melody with RNN's then having subsequent processes generate supporting harmonies.
  - p1esk 9y ago
    Can you show us some of those good results?
    - stevehiehn 9y ago
      These are results from starting with just a chord progression & stacking ontop of it: http://signalsandsorcery.com http://signalsandsorcery.com About 5 months ago I decided to pivot & start with a melody & chords. I have not yet stood up the system that starts with chords & melody. So the answer is not yet.
      - 9y ago

deleted 9y ago

[deleted]