3 ms·
Impressive, but those 63 nodes were "Azure Standard E64pds v6 nodes, each providing 64 vCPUs and 504 GiB of RAM." That's 4000 CPUs and 30TB memory.
by tgv 1y ago
Impressive, but those 63 nodes were "Azure Standard E64pds v6 nodes, each providing 64 vCPUs and 504 GiB of RAM." That's 4000 CPUs and 30TB memory.
- ralegh 1y agoJust noting that 4000 vCPUs usually means 2000 cores, 4000 threads
- RamtinJ95 1y agoAt that scale it cannot be cheaper than just running the same workload on BigQuery or Snowflake or?
- philbe77 1y agoA Standard E64pds v6 costs: $3.744 / hr on demand. At 63 nodes - the cost is: $235.872 / hr - still cheaper than a Snowflake 4XL cluster - costing: 128 credits / hr at $3/credit = $384 / hr.
- ramraj07 1y agoSounds like the equivalent of a 4xl snowflake warehouse, which for such queries would take 30 seconds, with the added benefit of the data being cold stored in s3. Thus you only pay by the minute.
- hobs 1y agoNo, that would be equivalent to 64 4xl snowflake warehouses (though the rest of your point still stands).
- philbe77 1y agoCost-wise, 64 4xl Snowflake clusters would cost: 64 x $384/hr - for a total of: $24,576/hr (I believe)
- __mharrison__ 1y agoWhat was the cost of the duck implementation?
- ramraj07 1y agoApologize for getting it wrong a few orders of magnitude, but thats even more ghastly if its so overpowered and yet takes this long.
- philbe77 1y agoChallenge accepted - I'll try it on a 4XL Snowflake to get actual perf/cost