4 ms·
Nowadays, there isn't a huge practical difference in terms of performance/tooling aside from edge cases and deployment options. It mostly depends on your syntax
by minimaxir 6y ago
Nowadays, there isn't a huge practical difference in terms of performance/tooling aside from edge cases and deployment options. It mostly depends on your syntax preference. (although there are flame wars from both sides)
I noted the TensorFlow usage because the original GPT-2 release was TensorFlow 1.X, which led to issues when TensorFlow 2.0 was released soon after.
For model training, I strongly recommend using the higher-level Keras APIs for TensorFlow/pytorch-lightning API for PyTorch than the respective base tools.
- m0zg 6y agoThere is a huge difference in developer experience still. When TF fails it typically offers little to no clue as to what you can do to rectify the situation. PyTorch is a lot more helpful most of the time. PyTorch is worth choosing on this basis alone, unless you intend to deploy to mobile hardware, where TFLite is the only real viable option.
- fxtentacle 6y agoTF can compile to optimized C++. When you use PyTorch with TPU, it'll internally use the TF XLA backend. If you intend to deploy on mobile, TF is easy and PyTorch is pain. But TF has obscure bugs and error messages.