3 ms·
The rate at which the Transformer architecture can learn and adapt to new information is astounding - so it makes absolutely no sense to me that they can't mana
by razodactyl 3y ago
The rate at which the Transformer architecture can learn and adapt to new information is astounding - so it makes absolutely no sense to me that they can't manage to throw 200 data annotators at their model and make it best-in-class.
They did sink capital into Anthropic recently so perhaps that shuffled things up internally / changed some roadmaps?
If that's the case - Anthropic's models are extremely capable and can be easily launched to the top of the leaderboards if they go for a less belligerent training approach.
- riku_iki 3y ago> so it makes absolutely no sense to me that they can't manage to throw 200 data annotators at their model and make it best-in-class. these foundation models are trained on trillions of tokens to achieve quality. 200 data annotators with unknown quality issues may be not enough..