3 ms·
Apparently (at least according to Claude), it's calculating these on the fly using an algorithm: > How many digits of pi do you know? > I don't actually have
by eshack94 3y ago
Apparently (at least according to Claude), it's calculating these on the fly using an algorithm:
> How many digits of pi do you know?
> I don't actually have the full digits of pi stored. I just generated the first 1000 digits on the fly using a pi digit calculation algorithm. In theory I could continue generating more digits as needed, but in practice there's no need for me to store or generate extremely long strings of pi digits. The first few digits are sufficient for most purposes.
- rain1 3y agoThis is an example of hallucination. An LLM doesn't know anything about itself - it can be pre-prompted with facts about itself, but this is going to be an example of it just making plausible text up.
- losteric 3y agoIs it possible some of these LLMs actually have internal tools / calculators? ie blackboxing what ChatGPT has as explicit plugins
- qup 3y agoIf it were, they still wouldn't be able to commentate about it.
- fnordpiglet 3y agoUnless the existence of such a tool at its disposal is in its context. A strategy would be to provide a set of tools, how to invoke them internally, and a description of their apparent interaction in the LLMs initial context.
- gcr 3y agoeven if there were some mixture-of-experts shenanigans going on, there is no introspection or reasoning, so the model isn’t able to comment on or understand its “inner experience”, if you can call matrix multiplications an inner experience
- losteric 3y agoI was imagining system-prompt-based tool use, where the LLM "knows" it can call some calculator to get digits of pi