2 ms·

so linear

• tsimionescu 4y ago
  Honestly, I would argue that progress in AGI is actually sublinear. We are not significantly closer to AGI today than we were in the 1950s, as far as I can tell. The fact that LMs can seem like they generate meaningful sentences is nothing more than a nice trick. My bet is that they will turn out to be a dead-end on the path to actual language processing (that is, the ability to read a book and use the information therein to achieve a goal).