3 ms·

Don't they just rent them out to the frontier AI shops? They're not sitting idle.

• stavros 3mo ago
  They do, yes.
• londons_explore 3mo ago
  There are various difficulties with renting GPUs, especially if your setup is very custom. The competitor would have to port their training systems to your specific network architecture, system design, rdma Vs ethernet vs infiniband Vs nvlink etc. Getting it running might not be too hard, but getting it running efficiently and making good use of all those flops will require considerable human effort and wall time. Add that to the fact most frontier labs seem to have a single huge training run - and to my knowledge nobody has figured out how to distribute that training run between data centers effectively.
  • rjh29 3mo ago
    Surely rented GPUs would be used for inference, which runs anywhere and needs to scale much larger than a training run.
  • loeg 3mo ago
    I'm not saying this as a hypothetical -- I believe xAI is already renting their GPU farm out to frontier labs. Whatever logistical challenges exist, enough of them seem to have been overcome.
  • solumunus 3mo ago
    They’ve said they’re renting them out.