7 ms·
Generating Music Using GANs and Deep Learning
- TheOtherHobbes 10y agoI'm baffled by this paper. They appear to be trying to generate music from broad musical gestures caught on video. They seem surprised that you can't train a network to synthesize good music from a statistical map of sounds and gestures. This makes as much sense as using a video of the postures of a developer at work as a training set, combined with code output, and then wondering why this doesn't generate useful apps when fed by a live posture csm. Am I missing something?
- dman 10y agoYou are missing the the magic word "deep" in the title. I was looking at Nvidias GPU conference session lineup recently, it was hilarious how many talks had the words "deep learning" in the title.
- AndrewKemendo 10y agoWhy would that be hilarious? NVIDIA GPUs are the primary platform where Deep Learning training and inference is being done. Not only that, NVIDIA is making that the core of what they do
- edge17 10y agoIt's getting a lot of press for sure, but most of their profit (by a large margin) still comes from gaming
- ganfortran 10y agoBack in the day, it is the same sheep effect with 'XXX Topic Model'
- sdenton4 10y agoOnly kinda crazy. As a ukulelist, when I sit in with (say) a guitarist, I do a sequence-to-sequence translation of the chords I see my friend playing to chords I can play. If you know your instrument well, you know the sound that goes with certain visual configurations. So you can think of it as sequence-to-sequence translation with a very non-traditional input.
- ChuckMcM 10y agoGenerative Adversarial Networks (GANs) are a new thing and it is not at all clear where their best applications will be found. So there are a lot of people throwing them at different problems to see how well they perform (or don't).
- du_bing 10y agoAny open source code released? I am very interested to have a try!
- virmundi 10y agoI doubt it. This is academia. When discussing releasing the code to prove that the researchers did what they said, I was told that I was unreasonable and should just trust people. If that worked, my house would run on cold fusion and my hybrid would fly. Edit: science requires reproducing. Opening the code is literally enabling reproduction. When researchers refuse to do that, they refuse to be scientists. I find this especially irksome when there are public funds used NG the researchers.
- phreeza 10y agoNot true for the ML scene, code is very frequently released. cf. http://www.gitxiv.com/ http://www.gitxiv.com/
- slaymaker1907 10y agoIt can be somewhat tricky though if maybe they want to open source, but the code simply isn't ready yet to be released. The presumption there being that they will eventually open source their code.
- mijoharas 10y agoThey could release it under the crapl[0]. [0] http://matt.might.net/articles/crapl/ http://matt.might.net/articles/crapl/
- chriswarbo 10y agoThankfully this is starting to change; the UK research councils already require open access to papers as a requirement for funding, and they're currently looking at open access to data (which would include code). It's currently a bit fuzzy what open data requirements would be, so before enforcing the requirement they're trying to pin it down with regard to things like subject/patient/etc. confidentiality, industrial agreements, what to do about massive datasets (e.g. TB+), etc. There is hope!
- cs702 10y agoYet another example of generative adversarial networks learning mindbogglingly complicated functions, in this case, a function that takes an image of a person playing an instrument and produces sounds made by that instrument, and another function that does the opposite (i.e., generates an image of a person playing an instrument from a sound sample). Very cool.
- setrofim_ 10y agoReminds me of: here was a whole chain of separate departments dealing with proletarian literature, music, drama, and entertainment generally. Here were produced rubbishy newspapers containing almost nothing except sport, crime and astrology, sensational five-cent novelettes, films oozing with sex, and sentimental songs which were composed entirely by mechanical means on a special kind of kaleidoscope known as a versificator. -- George Orwell, 1984
- mijoharas 10y agoDo they not have links to the audio generated anywhere?