3 ms·
The timeout doesn't matter much, you can periodically save to drive. I spent like a month (subjectively) training gpt2 on Colab by just letting it run for a whi
by Tenoke 5y ago
The timeout doesn't matter much, you can periodically save to drive. I spent like a month (subjectively) training gpt2 on Colab by just letting it run for a while and save the weights to drive and then pick up from there next time. I've done the same with GANs, too over a couple of days.
https://svilentodorov.xyz/blog/stylegan-for-evil/ https://svilentodorov.xyz/blog/stylegan-for-evil/
https://svilentodorov.xyz/blog/gpt-15b-chat-finetune/ https://svilentodorov.xyz/blog/gpt-15b-chat-finetune/