2 ms·
It's not that slow. And you can use many TPUs together to make up the speed difference.
by sillysaurusx 7y ago
It's not that slow. And you can use many TPUs together to make up the speed difference.
- nil-sec 7y agoIf that were the case I am wondering why anyone would buy GPUs? I invite you to retrain a state of the art model of your choice on a CPU and see how far you get.
- sillysaurusx 7y agoWe fine-tuned GPT-2 1.5B for subreddit simulator using this technique. https://www.reddit.com/r/SubSimulatorGPT2Meta/comments/entfgx/update_upgrading_to_15b_gpt2_and_adding_22_new/ https://www.reddit.com/r/SubSimulatorGPT2Meta/comments/entfg...