For one, what you are modeling itself does not need to be differentiable, only the network itself needs to be. No. In some simple cases you can model a non dif

For one, what you are modeling itself does not need to be differentiable, only the network itself needs to be. No. In some simple cases you can model a non differentiable function with a differentiable one accurately. But your model is likely not to perform well if the underlying relation between your parameters and observations is non differentiable, because your model will likely be unstable. Second, using neural networks in combination with other techniques for program synthesis is an active area of research currently, and although it is currently at around 50 lines or so, your fundamental assertion here is wrong. Sorry, but NNs haven't made any significant progress in the realm of program synthesis. I can set up a model with Transformers and BERT that spews out thousands of lines of code that stylistically look correct, but does not compile. NNs aren't the right tool for the job here. Third, there are a number of ways that deep learning could be leveraged in app development That has nothing to do with the original post. There's no AI that's going to write an app for you.