4 ms·
Conal Elliott (the guy who co-invented FRP) did a nice project on shading computational surfaces by extracting derivatives from code more than a decade ago: ht
by seanmcdirmid 7y ago
Conal Elliott (the guy who co-invented FRP) did a nice project on shading computational surfaces by extracting derivatives from code more than a decade ago: http://conal.net/Vertigo/ http://conal.net/Vertigo/
He is now very active in the differentiable programming community, but he got started on the problem in the graphics field.
- noblethrasher 7y agoHe also gave nice presentation on AD: https://www.youtube.com/watch?v=ne99laPUxN4 https://www.youtube.com/watch?v=ne99laPUxN4 (surprised that you didn't already mention it, considering the venue ;-))
- kragen 7y agoThe manifesto links one of his papers, "The simple essence", which I've started but haven't finished.
- seanmcdirmid 7y agoHe has been working on that for a long time. Though much of his earlier work is symbolic differentiation, I’m not very familiar with the more recent AD stuff.
- thechao 7y agoLet me mostly summarize Conal’s “simple” reverse AD: he drops the tape into the stack. This has two impacts: the stack is “about twice as long”; and, you “may (will?) lose tail recursion”. It is still a really good paper—and no doubt a lot of the subtlety was list to me.