3 ms·
> and that seems highly likely to continue for the next few (at least) Why? Text training data is already exhausted.
by slashdave 2y ago
> and that seems highly likely to continue for the next few (at least)
Why? Text training data is already exhausted.
- fennecfoxy 2y agoYes, turns out in the context of machines, all of the names we've given to things and concepts is not a very large set in the scheme of things. Next focus will hopefully be on reasoning abilities. Probably gonna take another decade and a similar paper to attention is all you need before we see any major improvements...but then again all eyes are on these models atm so perhaps it'll be sooner than that.