7 ms·
Framing GPT 5 as a loss because of its short run like that is a bit weird. They say "the R&D that went into GPT-5 likely informs future models like GPT-6". bu
by Lerc 9mo ago
Framing GPT 5 as a loss because of its short run like that is a bit weird. They say "the R&D that went into GPT-5 likely informs future models like GPT-6". but that really understates what is happening here.
Barring solid evidence otherwise you would think that GPT 5.2 was built largely on GPT 5, enough that possibly the majority of the cost of 5.2 was in developing GPT 5.
It would be like if you shipped something v1.0 on day one and discovered a bug and shipped something v1.01 the next day. Then at the end of the year reported that v1.0 massively lost money but you wouldn't believe the profit we made on v1.01 it was the single largest return on a single day of development we've ever seen.
- matusp 9mo agoIf this was the case, we would see R&D costs dropping for OpenAI. Not sure if that is the case.
- Lerc 9mo agoThey do still train models from scratch, and they are still making larger models. You would expect that to use a lot more resources. It seems to be that GPT 5.x are all likely to be extensions of the gpt5 base model with similar numbers of parameters. The money spent on extending base models would be dwarfed by the scale increase of the next major number.