4 ms·

One of the issues is availability. Lambdalabs and Paperspace never have instances available. AWS and GCP have the per-account quota set to 0 by default for GPU

One of the issues is availability. Lambdalabs and Paperspace never have instances available. AWS and GCP have the per-account quota set to 0 by default for GPU instances and deny requests to raise it, even to 1. (One of my AWS accounts was granted 1 GPU after some back-and-forth with support.) I'm not upset, I understand that demand is high, but how will oblivus handle availability?

oblivuslimited 3y ago
Thank you for your question! Firstly, unlike AWS, GCP, or Azure, there are no restrictions on the number of GPUs you can deploy with us. As long as you have sufficient account balance, you can deploy hundreds of GPUs simultaneously. In terms of availability, we maintain a diverse range of resources from various vendors in our on-demand stock. While we have our own infrastructure, we also leverage infrastructure from other vendors to meet the growing demand. Currently, we have more than 3000 GPUs in stock, with over 2600 of them available for deployment. You can find more detailed information on our availability page at https://oblivus.com/availability/ https://oblivus.com/availability/. I hope this helps!
- yanslookup 3y ago
  > you can deploy hundreds of GPUs simultaneously. > with over 2600 of them available for deployment. guessing you mean 2600 in total. FWIW we ran a workload recently on AWS that required a few thousand g4 instances in a single AWS region. We ended up scavenging and using g3s as well due to capacity constraints.
  - oblivuslimited 3y ago
    That's quite an impressive workload! If you're using our on-demand service and intend to terminate the machines once your work is completed, we currently have 2600 available GPUs. However, if you have an ongoing need for these machines, we also have reserved instances with additional stock, which brings our total capacity to an estimated 7000 GPUs as of today. But of course these numbers could easily change in the future.
  - williamstein 3y ago
    I think they mean that almost 2600 are literally available right now for you to rent - or if you requested them, then you would get them right now, and then there would - for a while - be 0 that are available, because you have them all.
  - anonymousDan 3y ago
    Out of interest, was this workload for training or serving?
deleted 3y ago
[deleted]

oblivuslimited 3y ago

Thank you for your question! Firstly, unlike AWS, GCP, or Azure, there are no restrictions on the number of GPUs you can deploy with us. As long as you have sufficient account balance, you can deploy hundreds of GPUs simultaneously. In terms of availability, we maintain a diverse range of resources from various vendors in our on-demand stock. While we have our own infrastructure, we also leverage infrastructure from other vendors to meet the growing demand. Currently, we have more than 3000 GPUs in stock, with over 2600 of them available for deployment. You can find more detailed information on our availability page at https://oblivus.com/availability/ https://oblivus.com/availability/. I hope this helps!

yanslookup 3y ago
> you can deploy hundreds of GPUs simultaneously. > with over 2600 of them available for deployment. guessing you mean 2600 in total. FWIW we ran a workload recently on AWS that required a few thousand g4 instances in a single AWS region. We ended up scavenging and using g3s as well due to capacity constraints.
- oblivuslimited 3y ago
  That's quite an impressive workload! If you're using our on-demand service and intend to terminate the machines once your work is completed, we currently have 2600 available GPUs. However, if you have an ongoing need for these machines, we also have reserved instances with additional stock, which brings our total capacity to an estimated 7000 GPUs as of today. But of course these numbers could easily change in the future.
- williamstein 3y ago
  I think they mean that almost 2600 are literally available right now for you to rent - or if you requested them, then you would get them right now, and then there would - for a while - be 0 that are available, because you have them all.
- anonymousDan 3y ago
  Out of interest, was this workload for training or serving?

deleted 3y ago

[deleted]