16 ms·
Yep all the author needs to do is download a few hundred MIDI files, play them, and record the piano -- it would be an interesting dataset to play with. Most o
by dheera 6y ago
Yep all the author needs to do is download a few hundred MIDI files, play them, and record the piano -- it would be an interesting dataset to play with.
Most of even the top of the line digital pianos seem to get the resonances and cross-talk between the strings wrong in my opinion, and I think a neural net should possibly be able to learn the internal physics of the piano from enough samples.
- jacquesm 6y agoAuthor here... Unfortunately there is a pretty busy road passing my house which would preclude miking the piano and getting meaningful results. Also: that's a lot of combinations! But you are right, going this route should in theory give you a way to generate audio that comes much closer to the real interaction between the strings and the soundboard than the mixer step at the end of your typical digital piano. They all sound way too clean.
- keeganpoppen 6y agowould definitely be amazing for someone to do this. i do believe that there is some more accurate sounding piano synthesis software (or whatever you want to call it) out there that relies more directly on huge libraries of actual recordings of playing steinways, etc. recording each key a bunch of different ways and then ~interpolating between all those various recordings during synthesis, which in my limited playing around with it seemed to work relatively well (not that i had a steinway laying around, of course), but is definitely not as inspiring or scalable an approach. really, really cool hack btw. always inspiring to see people put "unreasonable" amounts of time into labors of love like this. :)
- jacquesm 6y agoThe upside of the COVID lockdown I guess.
- tkgally 6y ago> Most of even the top of the line digital pianos seem to get the resonances and cross-talk between the strings wrong in my opinion I agree. A well-maintained, in-tune acoustic piano, especially a grand, has a richness of tone that digital pianos cannot match. The main problem with digital seems to be the resonance between the strings, which has apparently been difficult to model well. Your neural-net suggestion might work better. Decent digital pianos, though, are superior to mediocre acoustic pianos, which can be unpleasant to play or listen to. They also require little or no maintenance and can be played with headphones, a definite advantage for many living situations.
- dheera 6y agoYep. I'd be happy if I can make my digital sound as good as a YouTube recording of a concert grand, which obviously isn't as good as a real piano in richness and spatial feeling but the the quality of the resonances is there in the recording. I have a Kawai CA48 which is pretty good for digital but it still falls short of what I hear on YouTube recordings of Bosendorfers or Steinways playing through the same speakers, and I think that's a good neural net synthesis problem to match the sound indistinguishably to the quality of those recordings.