It really depends on what level allow yourself to start. If you hand derive all equations in your program you are going to have a hard time ... but automatic d

It really depends on what level allow yourself to start. If you hand derive all equations in your program you are going to have a hard time ... but automatic differentiation (ad) and existing linear algebra libraries (for gradient descent/ADAM) make the the job pretty easy. I recently dabbled in automatic (song-)mixing ... reimplemented the code of some open audio plugins in a way that they were auto-derivable and "trained" the whole thing on some multitracks with reference mixes. Sadly that didn't resulted in a good mix ... but in theory it should work. What's your "simple deep learning" story?