3 ms·
> What this tells us for AI is that we need something else besides LLMs. Despite being an LLM skeptic of sorts, I don’t think that necessarily follows. The LLM
by layer8 2y ago
> What this tells us for AI is that we need something else besides LLMs.
Despite being an LLM skeptic of sorts, I don’t think that necessarily follows. The LLM matrix multiplication machinery may well be implementing an equivalent of the human non-language cognitive processing as a side effect of the training. Meaning, what is separated in the human brain may be mixed together in an LLM.