Like you, I suspect there are substantial bulk discounts available if you're using tens of millions of dollars worth of these. I don't know how much less, but

Like you, I suspect there are substantial bulk discounts available if you're using tens of millions of dollars worth of these. I don't know how much less, but if you were to do fully pre-emptible at this scale I wouldn't be surprised if you could get it down to one-tenth the price. I wouldn't suspect the same of other more generic resources like CPUs that have a much lower price point to begin with, but the TPU sticker price seems very high with lots of headroom.