5 ms·

Why not run something like 8 x L40's for $4,750 a month from a bare metal provider like latitude.sh? This seems far more cost efficient and flexible.

deleted 2y ago
[deleted]
015a 2y ago
I think you're reading that page wrong; but their pricing page is so confusing that its giving me red flags already. It says that would cost $6.51/hr and $4752/yr: I think you pay both of those things. I think the first number is the hourly cost, and the second number is the annual commitment. So its $56,246/year if you're running 24x7 + $4,756 = $61,002/year total.
- adityapatadia 2y ago
  I think a single L40 costs $1320 a month on latitude. L40 is also an older GPU.
  - genewitch 2y ago
    it's hopper vs grace hopper and afaik doesn't require custom boards, but i haven't really looked in to it too much as both are far outside my personal price range.
  - guisalberto 2y ago
    Latitude.sh provides the L40S, not L40 The on demand cost is $9.30/hr and $4,752/mo when paid a year upfront
- guisalberto 2y ago
  I am sorry if you are finding our pricing page confusing. We had a recent update to that page and we had a glitch for prices for the GPUs. Anyway, the correct price for a 8 x L40S is $4752/mo when paid a year upfront.
  - 015a 2y ago
    So, when the page now says "$6.51/hr // $4,752/mo", that's really just presenting the same actual cost you'd have to pay, across two different time metrics? As in, you pay $6.51/hr, or you pay $4,752/mo, same thing, but not both? I think you need to consider: Your competitors (e.g. AWS) generally structure annual commitments as an upfront (or monthly) payment + a reduced cost per hour/minute for the resource being reserved; that's the lens through which most people viewing this page will be thinking. If that is not how you structure annual commitments, then that should be made very clear. If my first paragraph is correct (and again, the page is still confusing, its not obvious to me that this interpretation is correct): You should list one price, and give a dropdown at the top to change the computation of that price across whatever timeframe the user wants ($/hr, $/day, $/month, etc). That would also free up some space in-line to put a chip that says something like "-15% discount!".
SteveNuts 2y ago
It looks like their on-demand price would cost $81,468 per year So even at the reserved price for a year (365 * 24 * $6.51) you're nowhere near $4,750 per year, it's closer to $60k
pella 2y ago
> "Dedicated GPU clusters for accelerated computing" - so you have to add the price of AMD/Intel bare metal servers. - the price of "Networking" PER TB - and the "Additional services pricing" https://www.latitude.sh/pricing https://www.latitude.sh/pricing
- guisalberto 2y ago
  That's all included, you don't have to add the bare metal servers, networking or anything else.
  - pella 2y ago
    thanks, the webpage is not clear ... "Bandwidth Pricing is based on the country your server is located. Packages are billed monthly and sold in increments of 10 TB."

deleted 2y ago

[deleted]

015a 2y ago

I think you're reading that page wrong; but their pricing page is so confusing that its giving me red flags already. It says that would cost $6.51/hr and $4752/yr: I think you pay both of those things. I think the first number is the hourly cost, and the second number is the annual commitment. So its $56,246/year if you're running 24x7 + $4,756 = $61,002/year total.

adityapatadia 2y ago
I think a single L40 costs $1320 a month on latitude. L40 is also an older GPU.
- genewitch 2y ago
  it's hopper vs grace hopper and afaik doesn't require custom boards, but i haven't really looked in to it too much as both are far outside my personal price range.
- guisalberto 2y ago
  Latitude.sh provides the L40S, not L40 The on demand cost is $9.30/hr and $4,752/mo when paid a year upfront
guisalberto 2y ago
I am sorry if you are finding our pricing page confusing. We had a recent update to that page and we had a glitch for prices for the GPUs. Anyway, the correct price for a 8 x L40S is $4752/mo when paid a year upfront.
- 015a 2y ago
  So, when the page now says "$6.51/hr // $4,752/mo", that's really just presenting the same actual cost you'd have to pay, across two different time metrics? As in, you pay $6.51/hr, or you pay $4,752/mo, same thing, but not both? I think you need to consider: Your competitors (e.g. AWS) generally structure annual commitments as an upfront (or monthly) payment + a reduced cost per hour/minute for the resource being reserved; that's the lens through which most people viewing this page will be thinking. If that is not how you structure annual commitments, then that should be made very clear. If my first paragraph is correct (and again, the page is still confusing, its not obvious to me that this interpretation is correct): You should list one price, and give a dropdown at the top to change the computation of that price across whatever timeframe the user wants ($/hr, $/day, $/month, etc). That would also free up some space in-line to put a chip that says something like "-15% discount!".

SteveNuts 2y ago

It looks like their on-demand price would cost $81,468 per year So even at the reserved price for a year (365 * 24 * $6.51) you're nowhere near $4,750 per year, it's closer to $60k

pella 2y ago

> "Dedicated GPU clusters for accelerated computing" - so you have to add the price of AMD/Intel bare metal servers. - the price of "Networking" PER TB - and the "Additional services pricing" https://www.latitude.sh/pricing https://www.latitude.sh/pricing

guisalberto 2y ago
That's all included, you don't have to add the bare metal servers, networking or anything else.
- pella 2y ago
  thanks, the webpage is not clear ... "Bandwidth Pricing is based on the country your server is located. Packages are billed monthly and sold in increments of 10 TB."