2 ms·

When you say "at scale", how many cores are you likely wanting to use at once, and for how long? If it's for several hundred hours worth of compute, then dedic

When you say "at scale", how many cores are you likely wanting to use at once, and for how long? If it's for several hundred hours worth of compute, then dedicated servers can start to look pretty good. eg: https://www.hetzner.com/dedicated-rootserver/ax161 https://www.hetzner.com/dedicated-rootserver/ax161 €119.80/mo, for a 32 (real) core Zen2 EPYC with 128GB ram They generally tend to have better local disk performance than most cloud servers, but that might be irrelevant for your use case. :) If you're just doing short bursts of use though, then it's probably not the right option.

tyingq 3y ago
You'll would have to bump up from 128GB ram for a fair comparison. I didn't look exhaustively, but $.02/core-hour is hard to beat, especially since he's quoting that much memory and real (not smt/hyperthreads) core hours.
- justinclift 3y ago
  Oh, good point. Yeah, that'd need to double the ram if they're going to use 4GB ram per SMT core. :) Doing that moves the cost up to €165.80 for 64 SMT cores with 256GB ram for a full month. (Note - I've updated those prices as I previously forgot to set the region to "US" for the Hetzner pricing thing) -- Lets see if my math is working today. ;) €165.80 / 64 cores = 2.5906 per core, per month Using 720 hours a month for our purposes, that's €0.0036 per core hour. -- Use xe.com to do pricing conversion, that €165.80 is US$179.79. So, $179.79 / 64 cores = $2.809 per core, per month Using 720 hours a month for our purposes, that's US$0.0039 per core hour. So, about a fifth of the price of $.02/core-hour.
  - tyingq 3y ago
    That is comparing an SMT core to an actual core. The c5.18xlarge is 36/72 cores/vcpus. Still cheaper, yes. Though I don't know how much you lose in scheduling trying to keep it fully utilized 24/7 versus the spot pricing.
    - justinclift 3y ago
      Ok, I must be confused? You pointed out initially that it's 128GB ram for (only) 32 real cores. That's still 4GB ram per core. What am I misunderstanding? :) -- That being said, if they're just doing bursty work and won't use servers for long stretches then it's probably not the right choice.

tyingq 3y ago

You'll would have to bump up from 128GB ram for a fair comparison. I didn't look exhaustively, but $.02/core-hour is hard to beat, especially since he's quoting that much memory and real (not smt/hyperthreads) core hours.

justinclift 3y ago
Oh, good point. Yeah, that'd need to double the ram if they're going to use 4GB ram per SMT core. :) Doing that moves the cost up to €165.80 for 64 SMT cores with 256GB ram for a full month. (Note - I've updated those prices as I previously forgot to set the region to "US" for the Hetzner pricing thing) -- Lets see if my math is working today. ;) €165.80 / 64 cores = 2.5906 per core, per month Using 720 hours a month for our purposes, that's €0.0036 per core hour. -- Use xe.com to do pricing conversion, that €165.80 is US$179.79. So, $179.79 / 64 cores = $2.809 per core, per month Using 720 hours a month for our purposes, that's US$0.0039 per core hour. So, about a fifth of the price of $.02/core-hour.
- tyingq 3y ago
  That is comparing an SMT core to an actual core. The c5.18xlarge is 36/72 cores/vcpus. Still cheaper, yes. Though I don't know how much you lose in scheduling trying to keep it fully utilized 24/7 versus the spot pricing.
  - justinclift 3y ago
    Ok, I must be confused? You pointed out initially that it's 128GB ram for (only) 32 real cores. That's still 4GB ram per core. What am I misunderstanding? :) -- That being said, if they're just doing bursty work and won't use servers for long stretches then it's probably not the right choice.