3 ms·
> My expectations would be that a model that is better at one thing is better across the board. No, it's the opposite. This is simply a function of resources a
by slashdave 2y ago
> My expectations would be that a model that is better at one thing is better across the board.
No, it's the opposite. This is simply a function of resources applied during training.
- patapong 2y agoTo some extent I agree, but until now all of the big jumps (GPT2 -> GPT3 -> GPT4) have meant significant improvements across all tasks. This does not seem to be the case here, this model seems to be vastly stronger on certain tasks but not much of an improvement on other tasks. Maybe we will have to wait for GPT5 for that :)
- slashdave 2y ago> (GPT2 -> GPT3 -> GPT4) have meant significant improvements These were all train the same way. It's fairly clear that o1 was not. > Maybe we will have to wait for GPT5 for that :) There will be no GPT5, for the simple reason that scaling has reached a limit and there is no more text data to train on.