9 ms·

None of that matters if you already bought the H100 and have no use for it. You might as well recoup as much money as you can on it.

dwattttt 2y ago
If you already have the H100s, renting access to them at a loss isn't better. Throwing them in the trash will lose you less money.
- ericpauley 2y ago
  GGP already showed the marginal power cost is well below $2.
  - cheschire 2y ago
    There is so much more to lifecycle sustainment cost than that. Rackspace. Networking. Physical safety. Physical security. Sales staff. Support staff. Legal. Finance. HR. Support staff for those folks. That’s just off the top of my head. Sitting down for a couple days at the very least, like a business should, would likely reveal significant depths that $2 won’t cover.
    - H8crilA 2y ago
      So you terminate all of the above right now, or continue selling at a loss (which still extends the runway) and wait for better times? Also, do you know that similar situations occasionally occur in pretty much any market out there? The market doesn't care how much you're losing, it will set a price and it's up to you to take it, or leave it.
    - ericpauley 2y ago
      These are all costs of any server hosting business. Other commenters have already shown that $2/hr for a racked 1U server at 400W is perfectly sustainable.
      - dwattttt 2y ago
        Just because you have all of those costs already doesn't make them go away. If you're cross-subsidising the H100 access with the rest of a profitable business, that's a choice you can make, but it doesn't mean it's suddenly profitable at $2: you still need the profitable rest of the business in order to lose money here.
- michaelt 2y ago
  That's not how this works. Imagine I own a factory, and I've just spent $50k on a widget-making machine. The machine has a useful life of 25,000 widgets. In addition to the cost of the machine, each widget needs $0.20 of raw materials and operator time. So $5k over the life of the machine - if I choose to run the machine. But it turns out the widget-making machine was a bad investment. The market price of widgets is now only $2. If I throw the machine in the trash on day 1 without having produced a single widget, I've spent $50k and earned $0 so I've lost $50k. If I buy $5k of raw materials and produce 25k widgets which sell for $50k, I've spent $55k and earned $50k so I've lost $5k. It's still a loss, sure, but a much smaller one.
  - adgjlsfhk1 2y ago
    and for GPUs, the math is even more stark because rather than having a 25k item lifespan, the lifespan is the time until GPUs improve enough to make the current one irrelevant.
  - listenallyall 2y ago
    The concept you're looking for is "marginal cost". The initial $50,000 for the machine has already been spent - the only calculation left is that each new widget costs 20 cents to make (that's the marginal cost) and generates $2.00 in revenue. At this point, making widgets is highly profitable.
- dragonwriter 2y ago
  No, if its only a “loss” due to counting amortization of the sunk cost of initial acquisition, throwing them in the trash will lose you more money. The only way you can avoid the key cost is to travel back in time and not buy them, and, yeah, if you can do that instead, maybe you should (but, the time travel technology will make you more money than the H100s would ever cost, so maybe don't bother.)
ckastner 2y ago
> You might as well recoup as much money as you can on it. Depending on how fast their value depreciates, selling them might recoup more money then renting them away. And being exposed to 3y of various risks. Selling now at a 40% loss gets you back the equivalent of 60c/h over three years, and without having other costs (DC, power, network, security) and risks.

dwattttt 2y ago

If you already have the H100s, renting access to them at a loss isn't better. Throwing them in the trash will lose you less money.

ericpauley 2y ago
GGP already showed the marginal power cost is well below $2.
- cheschire 2y ago
  There is so much more to lifecycle sustainment cost than that. Rackspace. Networking. Physical safety. Physical security. Sales staff. Support staff. Legal. Finance. HR. Support staff for those folks. That’s just off the top of my head. Sitting down for a couple days at the very least, like a business should, would likely reveal significant depths that $2 won’t cover.
  - H8crilA 2y ago
    So you terminate all of the above right now, or continue selling at a loss (which still extends the runway) and wait for better times? Also, do you know that similar situations occasionally occur in pretty much any market out there? The market doesn't care how much you're losing, it will set a price and it's up to you to take it, or leave it.
  - ericpauley 2y ago
    These are all costs of any server hosting business. Other commenters have already shown that $2/hr for a racked 1U server at 400W is perfectly sustainable.
    - dwattttt 2y ago
      Just because you have all of those costs already doesn't make them go away. If you're cross-subsidising the H100 access with the rest of a profitable business, that's a choice you can make, but it doesn't mean it's suddenly profitable at $2: you still need the profitable rest of the business in order to lose money here.
michaelt 2y ago
That's not how this works. Imagine I own a factory, and I've just spent $50k on a widget-making machine. The machine has a useful life of 25,000 widgets. In addition to the cost of the machine, each widget needs $0.20 of raw materials and operator time. So $5k over the life of the machine - if I choose to run the machine. But it turns out the widget-making machine was a bad investment. The market price of widgets is now only $2. If I throw the machine in the trash on day 1 without having produced a single widget, I've spent $50k and earned $0 so I've lost $50k. If I buy $5k of raw materials and produce 25k widgets which sell for $50k, I've spent $55k and earned $50k so I've lost $5k. It's still a loss, sure, but a much smaller one.
- adgjlsfhk1 2y ago
  and for GPUs, the math is even more stark because rather than having a 25k item lifespan, the lifespan is the time until GPUs improve enough to make the current one irrelevant.
- listenallyall 2y ago
  The concept you're looking for is "marginal cost". The initial $50,000 for the machine has already been spent - the only calculation left is that each new widget costs 20 cents to make (that's the marginal cost) and generates $2.00 in revenue. At this point, making widgets is highly profitable.
dragonwriter 2y ago
No, if its only a “loss” due to counting amortization of the sunk cost of initial acquisition, throwing them in the trash will lose you more money. The only way you can avoid the key cost is to travel back in time and not buy them, and, yeah, if you can do that instead, maybe you should (but, the time travel technology will make you more money than the H100s would ever cost, so maybe don't bother.)

ckastner 2y ago

> You might as well recoup as much money as you can on it. Depending on how fast their value depreciates, selling them might recoup more money then renting them away. And being exposed to 3y of various risks. Selling now at a 40% loss gets you back the equivalent of 60c/h over three years, and without having other costs (DC, power, network, security) and risks.