sethaxen

4 ms·

1. 1.▲
   by sethaxen 5y ago

   Yes, precisely. It gets complicated very quickly. Cotangents for structural matrices in reverse-mode AD tend to wander away from the cotangent space at the corresponding point into the tangent space of the embedding for various reasons. Any
2. 2.▲
   by sethaxen 5y ago

   or that the tooling for the problems I do have is adequate in multiple languages.
3. 3.▲
   by sethaxen 5y ago

   My point is I think simpler than what you're talking about, so let's replace "symmetric" with "diagonal." Suppose I have a structurally diagonal matrix, represented by a type `Diagonal` that can only represen
4. 4.▲
   by sethaxen 5y ago

   Statistics is usually considered a subset of ML, except maybe by statisticians. While R definitely leads the pack on variety of useful stats packages, there are excellent tools for certain tasks in other languages. I do a lot of probabilist
5. 5.▲
   by sethaxen 5y ago

   I'd be interested to know whether that occurred pre- or post- Zygote.jl starting to use ChainRules.jl internally. Zygote's own rules used to be tested with a half-baked finite differences scheme, and it was easy to miss bugs. All