It is much older than this. People have started to come up with all kinds of differentiable structures ever since they've found out that the leaning rule back-p

It is much older than this. People have started to come up with all kinds of differentiable structures ever since they've found out that the leaning rule back-propagation of error can be derived using the chain rule in the early 1980s or so.