3 ms·
Can you support the position that language models are unable to reason? Secondly, how do you accurately guess the next word without the ability to reason? If r
by kypro 3y ago
Can you support the position that language models are unable to reason?
Secondly, how do you accurately guess the next word without the ability to reason? If reasoning can arise from GPT-4's architecture then we should assume that it will with enough scale. Given we don't even know the architecture of GPT-4 I genuinely have no idea how people make these baseless claims so confidently.
"It's a language model" and "it's just guessing the next token" isn't an argument. You're just a collection of atoms obeying physical laws. Obviously you don't reason. Am I doing this right?