6 ms·

Still pretty expensive IMO. I'm building a GPU accelerated signal processing web-app, and I'm currently planning to deploy it on a $180 Nvidia Jetson. Performa

Still pretty expensive IMO. I'm building a GPU accelerated signal processing web-app, and I'm currently planning to deploy it on a $180 Nvidia Jetson. Performances are a little bit low, but mostly enough to make the app usable. I tried to find GPU instances for < $50/month, but couldn't find any. The only alternative would have been to rent Apple M1 instances at Scaleway, but it's still way more expensive (€80/month) than hosting my 10 watts Jetson at home. Does anybody know cheaper GPU instances? I don't need much computing power, about 0.5Tflops to 1TFlops

oblivuslimited 3y ago
Thank you for your feedback! If you're working with Jetson, the RTX 4000 may be more powerful than you need right now, and it's the least expensive we've got. It's worth exploring if there are cloud service providers that offer lower-end GPUs, as that could potentially be a better fit for your requirements and budget.
sabalaba 3y ago
Lambda Cloud has A100 40GB for $1.10/hr—less than half the price of OP). We also just launched H100s for $2.40/hr. https://lambdalabs.com/service/gpu-cloud https://lambdalabs.com/service/gpu-cloud
- oblivuslimited 3y ago
  Engaging in self-promotion without taking the time to understand the context is not helpful. Moreover, the estimated cost of approximately $800 per month would still apply, which may not be within the desired budget.
  - ReDeiPirati 3y ago
    what do you mean with "the estimated cost of approximately $800 per month"?
    - jermaustin1 3y ago
      Parent is saying $1.10/hr = $792/mo of GPU leasing. GGP is looking for $50/mo. Obviously $792 is a lot higher than the GGP's request for $50/mo. Whether or not $50/mo is an unreasonable ask (it is), they have a budget and feel that even $85/mo is too far out of budget for their application.
    - nordsieck 3y ago
      > what do you mean with "the estimated cost of approximately $800 per month"? Presumably they mean $1.1/hr * 24hr/day * 30day/month = $792/month
  - Veen 3y ago
    How dare someone self-promote in the midst of your self-promotion?
    - oblivuslimited 3y ago
      I am answering to the version before you edited it. You are absolutely right, and I apologize if I came across as dismissive. We may have different viewpoints, and it's important to respect and acknowledge each other's perspectives. I appreciate your input, and I'm here to listen and address any further questions or concerns. Let's keep the conversation friendly and open.
- YetAnotherNick 3y ago
  > We also just launched H100s for $2.40/hr. What's the availability like? I had tried it once and had problem getting any GPU.
  - sabalaba 3y ago
    We have lots of H100s available right now.
    - williamstein 3y ago
      Thanks! Is there a status page like https://oblivus.com/availability/ https://oblivus.com/availability/ for Lambda Cloud? I got very excited about building a product on top of Lambda cloud for cocalc.com, but after read lots of docs, when I tried Lambda cloud, I just got the message: "We are currently out of capacity for all instances. Please check again in a few hours." This was on April 27. I immediately thought: "There is no possible way I can build a product on this for my users, but it may be very useful for other tasks, e.g., training." If there were something like https://oblivus.com/availability/ https://oblivus.com/availability/, especially with historical data, it would be very useful to appropriately set my expectations about how Lambda Cloud can best be used. By the way, Lambda Stack is VERY impressive. Thanks for maintaining that!
- alex_sf 3y ago
  Lambda availability is awful.
tehsauce 3y ago
On vast.ai I rent 3090s for $0.12 an hour. Nothing comes close in price.
- oblivuslimited 3y ago
  They operate a model known as a "marketplace" or "community" cloud. Unlike us, they utilize servers hosted by individuals in their homes. This is something completely different. While they may offer lower prices, the infrastructure may have limitations in terms of reliability, scalability, and security compared to data center-based providers. Additionally, the performance and availability of the services vary depending on the hosts' hardware and internet connection.
  - KomoD 3y ago
    No, it's not just individuals, and not just at home.
- mlboss 3y ago
  Biggest problem with vast.ai is data security. It is running on somebody's PC. Anybody can get hold of your data.
GC_tris 3y ago
Less than 50$ will be really hard, at least in any form of professional setup (so not hosted in a random basement ;) ). Our lowest at Genesis Cloud at this time are instances with an RTX 3060Ti for 0.20$/hour which adds up to 146$/month ( https://www.genesiscloud.com/pricing#nvidia3060ti https://www.genesiscloud.com/pricing#nvidia3060ti ) Though, this includes free storage, no egress fees and has a lot more power than a Jetson. If you need to optimize for low cost hosting, did you already check whether you actually must have a GPU for your use case? Modern CPU have some impressing capabilities.
- oblivuslimited 3y ago
  Here we have another instance of self-promotion that does not align with what GGP mentioned. Thank you, Genesis and Lambda, for promoting yourselves in a startup thread. Given your long-standing presence in this industry, I would expect better engagement from you.
  - zamnos 3y ago
    You were doing so well, self promoting and engaging with the community on your post earlier. I didn't expect to see you stoop to this level of commenting. Maybe it's time to step away from the keyboard for a while?
    - oblivuslimited 3y ago
      I appreciate and respect every user who contributes by asking questions, providing feedback, or sharing suggestions. However, it is disappointing and unreasonable to witness self-promotion from companies that have been established in this industry for a considerable period of time under a startup thread. Moreover, the fact that their self-promotion does not align with the intention of the original discussion and GGP explains their purpose. Their primary goal is not genuinely assisting or finding a solution. In such cases, as you can imagine, it's challenging for me to maintain respect.
      - zamnos 3y ago

oblivuslimited 3y ago

Thank you for your feedback! If you're working with Jetson, the RTX 4000 may be more powerful than you need right now, and it's the least expensive we've got. It's worth exploring if there are cloud service providers that offer lower-end GPUs, as that could potentially be a better fit for your requirements and budget.

sabalaba 3y ago

Lambda Cloud has A100 40GB for $1.10/hr—less than half the price of OP). We also just launched H100s for $2.40/hr. https://lambdalabs.com/service/gpu-cloud https://lambdalabs.com/service/gpu-cloud

oblivuslimited 3y ago
Engaging in self-promotion without taking the time to understand the context is not helpful. Moreover, the estimated cost of approximately $800 per month would still apply, which may not be within the desired budget.
- ReDeiPirati 3y ago
  what do you mean with "the estimated cost of approximately $800 per month"?
  - jermaustin1 3y ago
    Parent is saying $1.10/hr = $792/mo of GPU leasing. GGP is looking for $50/mo. Obviously $792 is a lot higher than the GGP's request for $50/mo. Whether or not $50/mo is an unreasonable ask (it is), they have a budget and feel that even $85/mo is too far out of budget for their application.
  - nordsieck 3y ago
    > what do you mean with "the estimated cost of approximately $800 per month"? Presumably they mean $1.1/hr * 24hr/day * 30day/month = $792/month
- Veen 3y ago
  How dare someone self-promote in the midst of your self-promotion?
  - oblivuslimited 3y ago
    I am answering to the version before you edited it. You are absolutely right, and I apologize if I came across as dismissive. We may have different viewpoints, and it's important to respect and acknowledge each other's perspectives. I appreciate your input, and I'm here to listen and address any further questions or concerns. Let's keep the conversation friendly and open.
YetAnotherNick 3y ago
> We also just launched H100s for $2.40/hr. What's the availability like? I had tried it once and had problem getting any GPU.
- sabalaba 3y ago
  We have lots of H100s available right now.
  - williamstein 3y ago
    Thanks! Is there a status page like https://oblivus.com/availability/ https://oblivus.com/availability/ for Lambda Cloud? I got very excited about building a product on top of Lambda cloud for cocalc.com, but after read lots of docs, when I tried Lambda cloud, I just got the message: "We are currently out of capacity for all instances. Please check again in a few hours." This was on April 27. I immediately thought: "There is no possible way I can build a product on this for my users, but it may be very useful for other tasks, e.g., training." If there were something like https://oblivus.com/availability/ https://oblivus.com/availability/, especially with historical data, it would be very useful to appropriately set my expectations about how Lambda Cloud can best be used. By the way, Lambda Stack is VERY impressive. Thanks for maintaining that!
alex_sf 3y ago
Lambda availability is awful.

tehsauce 3y ago

On vast.ai I rent 3090s for $0.12 an hour. Nothing comes close in price.

oblivuslimited 3y ago
They operate a model known as a "marketplace" or "community" cloud. Unlike us, they utilize servers hosted by individuals in their homes. This is something completely different. While they may offer lower prices, the infrastructure may have limitations in terms of reliability, scalability, and security compared to data center-based providers. Additionally, the performance and availability of the services vary depending on the hosts' hardware and internet connection.
- KomoD 3y ago
  No, it's not just individuals, and not just at home.
mlboss 3y ago
Biggest problem with vast.ai is data security. It is running on somebody's PC. Anybody can get hold of your data.

GC_tris 3y ago

Less than 50$ will be really hard, at least in any form of professional setup (so not hosted in a random basement ;) ). Our lowest at Genesis Cloud at this time are instances with an RTX 3060Ti for 0.20$/hour which adds up to 146$/month ( https://www.genesiscloud.com/pricing#nvidia3060ti https://www.genesiscloud.com/pricing#nvidia3060ti ) Though, this includes free storage, no egress fees and has a lot more power than a Jetson. If you need to optimize for low cost hosting, did you already check whether you actually must have a GPU for your use case? Modern CPU have some impressing capabilities.

oblivuslimited 3y ago
Here we have another instance of self-promotion that does not align with what GGP mentioned. Thank you, Genesis and Lambda, for promoting yourselves in a startup thread. Given your long-standing presence in this industry, I would expect better engagement from you.
- zamnos 3y ago
  You were doing so well, self promoting and engaging with the community on your post earlier. I didn't expect to see you stoop to this level of commenting. Maybe it's time to step away from the keyboard for a while?
  - oblivuslimited 3y ago
    I appreciate and respect every user who contributes by asking questions, providing feedback, or sharing suggestions. However, it is disappointing and unreasonable to witness self-promotion from companies that have been established in this industry for a considerable period of time under a startup thread. Moreover, the fact that their self-promotion does not align with the intention of the original discussion and GGP explains their purpose. Their primary goal is not genuinely assisting or finding a solution. In such cases, as you can imagine, it's challenging for me to maintain respect.
    - zamnos 3y ago