3 ms·
That's an interesting question. I think Colab times out after 24 hours - so it would need a bit more hand-holding. Additionally, there's no guarantee of what re
by edent 5y ago
That's an interesting question. I think Colab times out after 24 hours - so it would need a bit more hand-holding. Additionally, there's no guarantee of what resources you'll get with them - so the entire process will take a lot longer.
- Tenoke 5y agoThe timeout doesn't matter much, you can periodically save to drive. I spent like a month (subjectively) training gpt2 on Colab by just letting it run for a while and save the weights to drive and then pick up from there next time. I've done the same with GANs, too over a couple of days. https://svilentodorov.xyz/blog/stylegan-for-evil/ https://svilentodorov.xyz/blog/stylegan-for-evil/ https://svilentodorov.xyz/blog/gpt-15b-chat-finetune/ https://svilentodorov.xyz/blog/gpt-15b-chat-finetune/