2 ms·
This seems like great advice. You say don't write your own neural net and backprop implementation. That makes sense to me. What do you suggest using instead, f
by sanderjd 3y ago
This seems like great advice.
You say don't write your own neural net and backprop implementation. That makes sense to me. What do you suggest using instead, for your suggested projects? I'm guessing tensorflow, based on your suggestions on profiling and debugging tools? Do the papers / projects you suggest map straightforwardly onto a tensorflow implementation, rather than a custom one?
- uoaei 3y agoImplementations in Tensorflow are widely considered to be technical debt. Internally, Google has mostly switched to JAX. PyTorch now has torch.compile and exports to ONNX so there's little reason to use Tensorflow these days except in niche cases.
- sanderjd 3y agoThis kind of information is why I was asking :)