If I am to design a system for your need, I will avoid involving the audio level. I will first have a initialised NN; let it output some random note. These no

If I am to design a system for your need, I will avoid involving the audio level. I will first have a initialised NN; let it output some random note. These notes triggers some synth or sampler, right as the leading guitar in this example: https://glicol.org/demo#ambienthouse https://glicol.org/demo#ambienthouse Then you give feedback to each bar. Ideally, the NN will adapt to your feedback. For example, you only thumb up to pentatonic notes, the NN should be able to stick to them while occasionally be 'creative'. This is known as online machine learning, and it has been there quite of some time. JukeBox and RaveForce are just totally different stories.