4 ms·
I have to admit you're right. My case is a little different, where my jobs are about 1h long and it would take me longer to copy all the data to AWS than runnin
by 0xfaded 6y ago
I have to admit you're right. My case is a little different, where my jobs are about 1h long and it would take me longer to copy all the data to AWS than running it locally.
- 6gvONxR4sf7o 6y agoIf you transition your workflow to AWS, and do preprocessing and storage and training in AWS, it avoids the issue. As a benefit, storage in s3 is dirt cheap compared something like dropbox, and archival is easy and cheap enough to just forget about. I feel weird like I'm evangelizing amazon, but it's a workflow i'm very happy with and trying to streamline to take even more advantage of.