3 ms·
> What is instinct physically? Does it matter? As long as it conceptually exist that’s all that matters. LLMs don’t seek any goal. It’s advanced autocomplete.
by TerrifiedMouse 3y ago
> What is instinct physically?
Does it matter? As long as it conceptually exist that’s all that matters.
LLMs don’t seek any goal. It’s advanced autocomplete.
You can’t give it a bunch of facts and a goal then expect it to figure out how to achieve said goal. It can give you an answer if it already has it (or something similar) in its training set - in the latter case, it’s like a student who didn’t study for the exam and tries to guess the right answer with “heuristics”.
> A LLM also can't do multi-step reasoning, yet here we are.
Where’s “here”?
- Zambyte 3y ago> Does it matter? As long as it conceptually exist that’s all that matters. It does matter. Where is it? By evading this you have basically described "instinct" as something computers simply cannot have, axiomatically. That's boring. > LLMs don’t seek any goal. It’s advanced autocomplete. These two sentences are contradictory. > You can’t give it a bunch of facts and a goal then expect it to figure out how to achieve said goal. Have you used a language model lately? It sounds like you're saying things you think a LLM shouldn't be able to do as if they can't do them. Giving it a bunch of facts and a goal and expecting it to figure out how to achieve the goal is something you can do. It's not perfect, but they can be surprisingly good. > Where’s “here”? At a point in time where LLMs can do multi-step reasoning.