4 ms·
It is basically a single huge matrix multiplication — you need some form of loop/repetition/recursion to be Turing complete. Sure it is not a hard property, ex
by kaba0 3y ago
It is basically a single huge matrix multiplication — you need some form of loop/repetition/recursion to be Turing complete.
Sure it is not a hard property, excel, css with mouse movements, game of life are all that, but they need a “possibly forever running” part.
- ben_w 3y agoChatGPT does have a loop, that's why it produces more than one token. In this context, that the possibility of running "forever" would also exclude the humans (to which it is being compared) is relevant — even if we spend all day thinking in words at the rate of 160wpm and .75 words per token, we fall asleep around every 200k tokens, and some models (not from OpenAI) exceed that in their input windows.
- kaba0 3y agoYet I can solve many sudoku problems in a single wake cycle. Also, its output is language and it can’t change a former part of speech, can only append to it. When “thinking” about what to say next, it can’t “loop” over that, only whether to append some more text to it. Its looping is strictly within a “static context”.