2 ms·
> I don't see a clear ceiling in intelligence The plateau in this case is presumably how far you can advance intelligence from the current model architectures.
by chimprich 3y ago
> I don't see a clear ceiling in intelligence
The plateau in this case is presumably how far you can advance intelligence from the current model architectures. There seems to be diminishing returns from throwing more layers, parameters or training data at these things.
We will see improvements but for dramatic increases I think we'll need new breakthroughs. New inventions are hard to predict, pretty much by definition.
- tombert 3y agoThat's more or less what I was getting at; the cool new GANN and LLM models have a certain set of problems that they will solve exceptionally well, and then another set of problems that they will solve "pretty well", but I don't think they'll solve every problem.