3 ms·
I talk to people who want to set up infra to use cloud GPUs and many of them say "I want to use Modal". Common reasons not to include (1) "I have soooo many AW
by tomp 4y ago
I talk to people who want to set up infra to use cloud GPUs and many of them say "I want to use Modal".
Common reasons not to include (1) "I have soooo many AWS credits that I want to use" and (2) (our company's reason) "We have on-prem GPUs but sometimes need Cloud GPUs as well with the same interface".
Using e.g. Ray with AWS is very painful, took us a long time to iron out all the quirks.
- thundergolfer 4y agoYep AWS/GCP/Azure credits are a common reason. It's been discussed within the team, and we should work something out for that.