4 ms·

I've been saying this would happen for months. There (was) a giant arbitrage for data centers that already have the infra. If you could get a hold H100s and ha

I've been saying this would happen for months. There (was) a giant arbitrage for data centers that already have the infra. If you could get a hold H100s and had an operational data center you essentially had the keys to an infinate money printer on anything above $3.50/hr. Of course, because we live in a world of effecient markets that was never going to last forever. But they are still profitible at $2.00 assuming they have cheap electricity/infra/labor.

pico_creator 2y ago
Problem is - u can find some at $1
- startupsfail 2y ago
  The screenshot there is 1xH100 PCIE, for $1.604. Which is likely promotional pricing to get customers onboarded. With promotional pricing it can be $0 for qualified customers. Note also, how the author shows screenshots for invites for private alpha access. It can be mutually beneficial for the data center to provide discounted alpha testing access. The developer gets discounted access, the data center gets free/realistic alpha testing workflows.
  - electronbeam 2y ago
    The PCIE has much lower perf than even a 1x slice of an SXM
    - pico_creator 2y ago
      I really suggest shopping around. <$2 SXM is a real thing, if your patient enough on the schedule.
  - pico_creator 2y ago
    When I did the screenshot a month ago, it wasn't public info yet. Now its public: SFCompute list it on their main page - https://sfcompute.com/ https://sfcompute.com/ And they are *not* the only one
    - ipsum2 2y ago
      Okay, but you can't actually buy it at that price, it's a pure marketing ploy.
      - pico_creator 2y ago
        Not at $0.5 (which the lower bound in their marketing), but $1.5 is very doable on right times (done so multiple times) The article says $2. Which is quite consistent for a small cluster
        ipsum2 2y ago
        The average consumer cannot. Only those who have access to sfcompute's private beta can access those prices. Once it opens up to the public, the price will increase.
        zaptrem 2y ago
        Running preprocessing jobs on a $0.5 SFCompute H100 node RN (though price usually bounces up to what you mentioned).
  - shrubble 2y ago
    So are you thinking that the lower price is to get the customer in the door and then when they need the Infiniband connected GPUs to charge them more?
    - deleted 2y ago
      [deleted]
- swyx 2y ago
  original title i wrote for this piece was "$1 H100s" but i deleted because even i thought it was so ridiculously low lol but yes sfcompute home page is now quoting $0.95/hr average. wild.
  - ipsum2 2y ago
    sfcompute is a scam. You can't buy GPUs at that price. They're running a "private beta" where people can bid for a spot GPU, but they let a limited number of people into the beta, so the prices are artificially low.
    - pico_creator 2y ago
      I actually signed up for separate new account, to double check that my business account was not being favored or rigged in "private beta" Its really not that hard to validate this claim, you can just rent for 4 hours at $1.50 - which is under $50 Also like I said, they are *not* the only one, shop around
      - ipsum2 2y ago
        I signed up and don't have access currently. My point that the prices are low because demand is limited because of lack of users still stands. Once people sign up and hear about it, the price will increase substantially.
        qeternity 2y ago
        We are actively using sfcompute at the moment. It's a great product for us where we have a backlog of R&D workloads that can be incrementally run in short bursts. I think you're right about the small private beta resulting in relatively low demand. But it's also a different value prop. If you need a large cluster for a reasonable period of time, you're not paying $1/hr. But if you can use the remnants of someone who contracted for a large allocation, but doesn't need part of it, they can offer it into the market and recoup what would otherwise just be wasted hours. Currently they have some issues around stability, and spin up times are longer than ideal (ca. 15 min), but the team is super responsive and all of these are likely to be resolved in the near future. (No affiliation, just happy users rooting for the sfcompute team).

pico_creator 2y ago

Problem is - u can find some at $1

startupsfail 2y ago
The screenshot there is 1xH100 PCIE, for $1.604. Which is likely promotional pricing to get customers onboarded. With promotional pricing it can be $0 for qualified customers. Note also, how the author shows screenshots for invites for private alpha access. It can be mutually beneficial for the data center to provide discounted alpha testing access. The developer gets discounted access, the data center gets free/realistic alpha testing workflows.
- electronbeam 2y ago
  The PCIE has much lower perf than even a 1x slice of an SXM
  - pico_creator 2y ago
    I really suggest shopping around. <$2 SXM is a real thing, if your patient enough on the schedule.
- pico_creator 2y ago
  When I did the screenshot a month ago, it wasn't public info yet. Now its public: SFCompute list it on their main page - https://sfcompute.com/ https://sfcompute.com/ And they are *not* the only one
  - ipsum2 2y ago
    Okay, but you can't actually buy it at that price, it's a pure marketing ploy.
    - pico_creator 2y ago
      Not at $0.5 (which the lower bound in their marketing), but $1.5 is very doable on right times (done so multiple times) The article says $2. Which is quite consistent for a small cluster
      - ipsum2 2y ago
        The average consumer cannot. Only those who have access to sfcompute's private beta can access those prices. Once it opens up to the public, the price will increase.
      - zaptrem 2y ago
        Running preprocessing jobs on a $0.5 SFCompute H100 node RN (though price usually bounces up to what you mentioned).
- shrubble 2y ago
  So are you thinking that the lower price is to get the customer in the door and then when they need the Infiniband connected GPUs to charge them more?
  - deleted 2y ago
    [deleted]
swyx 2y ago
original title i wrote for this piece was "$1 H100s" but i deleted because even i thought it was so ridiculously low lol but yes sfcompute home page is now quoting $0.95/hr average. wild.
- ipsum2 2y ago
  sfcompute is a scam. You can't buy GPUs at that price. They're running a "private beta" where people can bid for a spot GPU, but they let a limited number of people into the beta, so the prices are artificially low.
  - pico_creator 2y ago
    I actually signed up for separate new account, to double check that my business account was not being favored or rigged in "private beta" Its really not that hard to validate this claim, you can just rent for 4 hours at $1.50 - which is under $50 Also like I said, they are *not* the only one, shop around
    - ipsum2 2y ago
      I signed up and don't have access currently. My point that the prices are low because demand is limited because of lack of users still stands. Once people sign up and hear about it, the price will increase substantially.
      - qeternity 2y ago
        We are actively using sfcompute at the moment. It's a great product for us where we have a backlog of R&D workloads that can be incrementally run in short bursts. I think you're right about the small private beta resulting in relatively low demand. But it's also a different value prop. If you need a large cluster for a reasonable period of time, you're not paying $1/hr. But if you can use the remnants of someone who contracted for a large allocation, but doesn't need part of it, they can offer it into the market and recoup what would otherwise just be wasted hours. Currently they have some issues around stability, and spin up times are longer than ideal (ca. 15 min), but the team is super responsive and all of these are likely to be resolved in the near future. (No affiliation, just happy users rooting for the sfcompute team).