3 ms·
Cannot understand people claiming we are in a local maxima, when we literally had an ai scientific breakthrough only in the last two years.
by ldjkfkdsjnv 3y ago
Cannot understand people claiming we are in a local maxima, when we literally had an ai scientific breakthrough only in the last two years.
- xanderlewis 3y agoWhich breakthrough in the last two years are you referring to?
- ldjkfkdsjnv 3y agothe LLM scaling law
- 6gvONxR4sf7o 3y agoIf you had to reduce it to one thing, it's probably that language models are capable few shot and zero shot learners. In other words, training a model to simply predict the next word on naturally occurring text, you end up with an tool you can use for generic tasks, roughly speaking.
- xyzzy_plugh 3y agoIt turns out a lot of tasks are predictable. Go figure.