4 ms·
How does this compare to Enzyme (https://enzyme.mit.edu/ https://enzyme.mit.edu/)?
by s_tim 2y ago
How does this compare to Enzyme (https://enzyme.mit.edu/ https://enzyme.mit.edu/)?
- frankling_ 2y agoEnzyme is traditional, but super duper optimized, autodiff, that is, it returns the partial derivatives for one path taken through the program, ignoring other branches. DiscoGrad captures the effects of alternative branches. What's special about enzyme is that the gradient computations benefit from LLVM's optimization passes and language support.