3 ms·
To some extent I agree, but until now all of the big jumps (GPT2 -> GPT3 -> GPT4) have meant significant improvements across all tasks. This does not seem to be
by patapong 2y ago
To some extent I agree, but until now all of the big jumps (GPT2 -> GPT3 -> GPT4) have meant significant improvements across all tasks. This does not seem to be the case here, this model seems to be vastly stronger on certain tasks but not much of an improvement on other tasks. Maybe we will have to wait for GPT5 for that :)
- slashdave 2y ago> (GPT2 -> GPT3 -> GPT4) have meant significant improvements These were all train the same way. It's fairly clear that o1 was not. > Maybe we will have to wait for GPT5 for that :) There will be no GPT5, for the simple reason that scaling has reached a limit and there is no more text data to train on.