4 ms·
Except that it does it by statistics. It does not understand, it gives the most likely answer. If Gemini had failed to give the answer or hallucinated anything
by aredox 1y ago
Except that it does it by statistics. It does not understand, it gives the most likely answer. If Gemini had failed to give the answer or hallucinated anything else, the original author wouldn't have written a blog post: this is in effect Publication Bias.
You see this every time you ask an LLM to give an answer several times to a question with only one right answer, such as math.
- ramses0 1y agoWe are all stochastic parrots. Statistically, everything you say is correct, but ask yourself- is it any different from your behavior of regurgitating the most likely relevant portions of your knowledge in the way you're guessing is most pleasing for others to perceive? Voltaire: "Most people think they are thinking when they are merely rearranging their prejudices."
- krapp 1y agoI don't believe humans are stochastic parrots, at least not in any way that makes drawing equivalence between human congnition and LLMs meaningful. Your own comment here would appear to be an example of something other than you "regurgitating the most likely relevant portions of your knowledge in the way you're guessing is most pleasing for others to perceive," since it contradicts the implied assumptions of the parent poster, who is in essence providing the prompt for your response. That said, Voltaire was a philosopher. Posting him as an appeal to authority for what amounts to an argument about neuroscience is specious. Posting actual research demonstrating that human cognition works in the same way as LLM token matching and, more so, that it is limited in the same ways such that the phrase "humans are stochastic parrots" should be considered a statement of fact rather than belief would make your argument stronger.
- staticman2 1y agoIt's not even a real Voltaire quote :)
- ramses0 1y agoCaught me in a hallucination! :-P ... per Google it's William James. Voltaire is the "I disapprove of what you say, but I will defend to the death your right to say it", which (per Google), is ALSO not a Voltaire quote, and instead "Friends of Voltaire" ... it's hallucinations fact-checked by Google all the way down! ;-)
- staticman2 1y ago"We are all stochastic parrots." Is there some good faith meaning of this slogan that I'm missing? Presumably you don't mean "Humans and LLMs are functionally identical." What does this slogan mean to you?
- aredox 1y agoIf you ask me the result of "2 + 2", I will always give you the same answer. No randomness there. LLM don't. And before you try: ChatGPT and others now simply calls plugins on math equations - running code written by humans. Without those crutches: https://www.reddit.com/r/LocalLLaMA/comments/1joqnp0/top_reasoning_llms_failed_horribly_on_usa_math/ https://www.reddit.com/r/LocalLLaMA/comments/1joqnp0/top_rea...
- doug_durham 1y agoWrong. When you were 3 year old and were asked what is "2 + 2" the answer would have been stochastic. What is the answer to 23093*32191 without resorting to using a machine or pencil and paper? Your answer will be stochastic. We are stochastic beings that have learned how to do deterministic calculations with difficulty. MCP servers are a first step in giving LLMs deterministic tools.
- aredox 1y ago"I don't know" isn't stochastic. Are you even human?