11 ms·
GPT-2, 3 and 4 keep on showing that increasing the size of the model keeps on making the results better without slowing down. This is remarkable, because usual
by cultureswitch 4y ago
GPT-2, 3 and 4 keep on showing that increasing the size of the model keeps on making the results better without slowing down.
This is remarkable, because usually in practical machine learning applications there is a quickly reached plateau of effectiveness beyond which a bigger model doesn't yield better results. With these ridiculously huge LLMs, we're not even close yet.
And this was exciting news in papers from years ago talking about the upcoming GPT3 btw.
- worrycue 4y agoYet they still can’t get it to shut the hell up if it doesn’t know and to not make shit up to pad its answers.
- bsder 4y ago"I don't know" isn't in the training set, after all. Welcome to Eternal September on the Internet. The first "AI" that actually says "I don't know" in response to a question will get my attention.