Don’t underestimate the length of time and magnitude of investment from MSFT. They spent years solving the technical problems that arise when trying to train th

Don’t underestimate the length of time and magnitude of investment from MSFT. They spent years solving the technical problems that arise when trying to train these models. They are currently the only corporation who knows how to host OpenAI-scale training. They are literally building data centers for OpenAI according to OpenAI’s whims. This is not an insurmountable lead but it could take years for others to catch up, or a dramatic change in GPU hardware/transformer architecture. They laid off 10s of thousands to “pay” for all of this (not in terms of dollars necessarily but in terms of messaging and public strategy).