3 ms·
This is exactly what happened with large language models: they are quite useless until a certain number of parameters, after which their abilities quickly becom
by blackbear_ 4y ago
This is exactly what happened with large language models: they are quite useless until a certain number of parameters, after which their abilities quickly become impressive (read more here: http://arxiv.org/abs/2001.08361 http://arxiv.org/abs/2001.08361)
- kaba0 4y agoExcept they are fundamentally limited and can’t algorithmically think no matter the scale?
- blackbear_ 4y agoI was merely commenting on the apparent similarity between the phase transition in ability observed in the brain of primates and artificial neural networks, without necessarily equating the capabilities of the two. On that note, maybe in the future we will discover some neural architectures that are able to "algorithmically think", who knows.