4 ms·
Is there an easy way to off-board the persistent disk to cheaper machines when you don't need the gpus? Like imagine, setting up and installing everything with
by itake 3y ago
Is there an easy way to off-board the persistent disk to cheaper machines when you don't need the gpus?
Like imagine, setting up and installing everything with the gpu attached, but when you're not using the gpu or all the cpu cores, you can disconnect them.
If you have docs on how to do this, please let me know.
- helsinkiandrew 3y agoWith AWS (and probably most other cloud VPC services) the disk is remote from the hardware so you can halt the CPU and just pay for the storage until you restart. AWS also provides accessible datasets of training data: https://aws.amazon.com/marketplace/search/results?trk=868d8747-614e-4d4d-9fb6-fd5ac02947a8&sc_channel=el&FULFILLMENT_OPTION_TYPE=DATA_EXCHANGE&CONTRACT_TYPE=OPEN_DATA_LICENSES&filters=FULFILLMENT_OPTION_TYPE%2CCONTRACT_TYPE https://aws.amazon.com/marketplace/search/results?trk=868d87...
- cmgbhm 3y agohttps://towardsdatascience.com/stop-duplicating-deep-learning-training-datasets-with-amazon-ebs-multi-attach-d9f61fdc1de4 https://towardsdatascience.com/stop-duplicating-deep-learnin... This is basically the building blocks.