It looks like your argument is essentially 'don't use a neural network when you can do a glm / other regression instead' which no serious person should disagree

It looks like your argument is essentially 'don't use a neural network when you can do a glm / other regression instead' which no serious person should disagree with.