big-chungus4

6 ms·

1. 121.▲
   by big-chungus4 2y ago

   vscode jupyter uses the same extensions as vscode, so you can get a linter and scrict type checking. Not sure about tests though
2. 122.▲
   by big-chungus4 2y ago

   can I, a mere mortal, use it?
3. 123.▲
   by big-chungus4 2y ago

   Doesn't JAX support dynamic graphs as well?
4. 124.▲
   by big-chungus4 2y ago

   hmm, I did not have the same experience. Anaconda makes managing python versions and environments extremely easy, and you can still use pip inside it if you want. But I have installed countless ML packages from both conda, pip-only and loca
5. 125.▲
   by big-chungus4 2y ago

   In `if i > x`, derivative with respect to x is mathematically 0 at all points. DiscoGrad gives you a useful smooth approximation that is not 0 and lets the function learn those conditional values.
6. 126.▲
   by big-chungus4 2y ago

   Julia's autodiff packages, as well as PyTorch, can differentiate through branching code -the gradients simply flow through whatever branch was used in forward pass. However, derivatives with respect to conditional values, such as `a` i
7. 127.▲
   by big-chungus4 2y ago

   I went through their folders, they have have a lot of classes that just inherit from pytorch and torchvision classes and seemingly do nothing new. All optimizers, schedulers and most layers do that. They do however have a reasonable amount
8. 128.▲
   by big-chungus4 2y ago

   They don't implement their own stuff, their optimizers just inherits pytorch optimizers