4 ms·
The results strike me as comparable or worse than you could get with a Markov model. I think it reveals the gap in understanding between LLMs and music. I think
by rajivayyangar 2mo ago
The results strike me as comparable or worse than you could get with a Markov model. I think it reveals the gap in understanding between LLMs and music. I think you need to either:
- Set up a pipeline to decompose music into, say, harmonic sequences and melodic sequences, and then have the LLM work on some more fundamental or more high-level layer of musical composition and then re-translate it back into actual sounds.
- Develop a better dataset and train the LLM more natively on musical examples.
Does anybody know of a project that has produced more convincing results?
- Computer0 2mo agoThere is no LLM in the ML pipeline provided by the OP.
- shannifin 2mo agoI'm not at all there yet, but this sort of thing is on my roadmap for my AI music project at tunesage.com ... That is, generating musical ideas while being conscious of phrase / melodic / thematic structure that a user can then play around with. While LLMs (and ANNs in general) are definitely great for musical analysis (though still limited), I think they're likely overkill for the generation part, plus they tend to suffer from "creative collapse" as they prefer averages rather than exploration (which can be good or bad depending on what you want).