3 ms·
Given the price increase and speculation that GPT 5 is a MoE model, I'm wondering if they're simply "turning up the good stuff" without making significant chang
by SkyPuncher 11mo ago
Given the price increase and speculation that GPT 5 is a MoE model, I'm wondering if they're simply "turning up the good stuff" without making significant changes under the hood.
- throwaway314155 11mo agoGPT 4o was an MoE model as well.
- minimaxir 11mo agoI'm not sure why being a MoE model would allow OpenAI to "turn up the good stuff". You can't just increase the number of E without training it as such.
- yberreby 11mo agoBased on what works elsewhere in deep learning, I see no reason why you couldn't train once with a randomized number of experts, then set that number during inference based on your desired compute-accuracy tradeoff. I would expect that this has been done in the literature already.
- SkyPuncher 11mo agoMy opinion is they're trying to internally route requests to cheaper experts when they think they can get away with it. I felt this was evident by the wild inconsistencies I'd experience using it for coding. Both in quality and latency You "turn of the good stuff" by eliminating or reducing the likelihood of the cheap experts handling the request.