2 ms·
Train the model with midi notes as text in the prompt and the audio as target. It will learn to interpret notes.
by visarga 3y ago
Train the model with midi notes as text in the prompt and the audio as target. It will learn to interpret notes.
- waffletower 3y agoNot all music is well represented with notes, nor are audio datasets with high-quality note representations readily available. But I guess if you work hard enough you can get close: https://www.youtube.com/watch?v=o5aeuhad3OM https://www.youtube.com/watch?v=o5aeuhad3OM My example still sounds like the chiptune simulation that it is, however.
- visarga 3y agoIt's ok, the model would create music even from a vague prompt, it will learn even better from the notes imperfect as they are, because it has the interpreted version in the training target.