3 ms·
Copying someone else's reasoning process (as best you understand it) is still a limited form of reasoning, even if it might be considered as cargo-cult reasonin
by HarHarVeryFunny 4mo ago
Copying someone else's reasoning process (as best you understand it) is still a limited form of reasoning, even if it might be considered as cargo-cult reasoning (copying without understanding).
- chrisjj 4mo ago> Copying someone else's reasoning process (as best you understand it) is still a limited form of reasoning The LLM is not copying someone else's process. All it knows it someone else's product, and its only process is to compute the most likely next token within that.
- HarHarVeryFunny 4mo agoTrue, and this is why I said "as best you understand it". The visible (copyable) circumstances in which someone makes a reasoning decision aren't the same as the internal decision making process, so this is just cargo-cult copying - copy the surface form without understanding the reason for it. The perhaps surprising thing is that it works so well some of the time - specifically for math and coding.
- chrisjj 4mo agoIts surprises people just as did a web seach 30 years ago. "Wow, it found my page amongst millions - in seconds!" Just because raw dumb huge computer power is beyond the average user's compehension.