> Oddly, it still uses TensorFlow like the original GPT-2 release despite OpenAI's declared switch to PyTorch Note the footnote in the paper where evaluations

> Oddly, it still uses TensorFlow like the original GPT-2 release despite OpenAI's declared switch to PyTorch Note the footnote in the paper where evaluations was interrupted by the move to MS Azure. This is relatively old work, and since it's literally GPT-2 but images, it's no surprise they didn't bother to rewrite it in PyTorch. If their next big from-scratch thing (presumably the multimodal GPT-like one-model-to-rule-them-all research I've been looking forward to ever since the TR article) is TensorFlow, then I'll be surprised.