They don't really exist. Ideally, this should all be integrated at the compiler level. Programming languages and their associated standard libraries should exp

They don't really exist. Ideally, this should all be integrated at the compiler level. Programming languages and their associated standard libraries should expose differentiation as a first-class abstraction, along with everything else. The problem is that the whole space is really immature, and huge strides are being made... but by many disparate groups, all working in different spaces and languages. Just in the last few months I read about several Python ML frameworks, a Julia differential compute capability, and that Haskell has a library where even the type system can express differentiation of general algebraic data types! The whole ecosystem needs to... congeal a little bit. This whole space reminds me of Object Oriented programming before C++ and Java.