2 ms·
Dear soheil, I happen to need around few thousand in GCP credits in order to egress around 30TB of data from our cloud buckets. It's training data, training lo
by sillysaurusx 5y ago
Dear soheil,
I happen to need around few thousand in GCP credits in order to egress around 30TB of data from our cloud buckets. It's training data, training logs, model snapshots, and pretty much all of our ML history (http://wiki.tensorfork.com/ http://wiki.tensorfork.com/).
The real tally is actually 83TB, but around 30TB of that is incremental model snapshots which we don't need to download (turns out, you can generate a lot of data when you're using TPUs for training), and around ~30TB is whatever-data that no one cares about / duplicated data across regions. (To use TPUs in EU and US, you need to place the training data in both EU and US.)
Normally I wouldn't ask, but we've been playing "hot potato" with this data for several months now, since our last credits ran out. We've basically been making new GCP accounts (where you get $300 credit) and then letting it sit there for a month (because they give you a month before deleting it, even if the credits run out).
If you'd be willing to help, it would be quite simple: I would transfer the buckets to your account, and then download the data to a Hetzner server. I'd then make the data publicly available, such as it is. You can DM me on twitter (https://twitter.com/theshawwn https://twitter.com/theshawwn) or email me (see profile). Thanks for considering!
EDIT: For an example of how we've amassed terabytes of training logs, you can see some of our BigGAN outputs here: https://twitter.com/search?q=from%3Atheshawwn%20biggan&src=typed_query https://twitter.com/search?q=from%3Atheshawwn%20biggan&src=t...
- google234123 5y agoDo these snapshots or models even matter anymore? Are snapshots from training some image generating model really useful to anyone and arent there already newer and better models out?