3 ms·
It does have the ability, you haven't allowed it to. If you're completing the sentence "What is the current price of Apple?..." based on the internet as a trai
by BoorishBears 3y ago
It does have the ability, you haven't allowed it to.
If you're completing the sentence "What is the current price of Apple?..." based on the internet as a training source, the most likely reply is not:
"Well, let's think about how we'd go about this, I should do a search for AAPL, and then..."
The most likely completion is:
"The price of AAPL is $X"
OpenAI had to "artificially" bias it to say "I can't answer that" or it'd happily tell you a million things like that.
—
On the other hand, give the LLM room to plan, it will plan. If you ask it "To answer x what do you need", it does better at answering x
The most likely completion to "How would you tell me Apple's current price", is a logical step by step process. And that's how it gets a chance to check itself.
I think people underestimate how much logic the model can do in a single pass, LLMs need to output things that we assume can be done with working memory