4 ms·
It's not trivial given current supply bottlenecks, not to mention research expertise.
by himaraya 3y ago
It's not trivial given current supply bottlenecks, not to mention research expertise.
- deleted 3y ago[deleted]
- drakenot 3y agoI don't feel like compute for pretraining the model was a huge constraint? The supply bottlenecks have been around commercializing the ChatGPT product at scale. But pretraining the underlying model I don't think was on the same order of magnitude, right?
- initplus 3y agoThe control of the supply si with Microsoft, who are likely falling on Sam’s side here.