3 ms·
That "it isn't matrix multiplication" argument is completely equivalent to "no computer can do it", and to "nobody can ever understand it". And is practically e
by marcosdumay 3y ago
That "it isn't matrix multiplication" argument is completely equivalent to "no computer can do it", and to "nobody can ever understand it". And is practically equivalent to "you need a soul to have intelligence".
The same applies to "brute force algorithms" and "otherwise gears could do it".
It's very likely that the current crop of LLMs do the wrong set of matrix multiplications. (If you ask me, it's a certainty.) But that doesn't change the fact that matrix multiplications can do anything.