> AI is an oracle just tells you what you're looking for. LLMs are oracles that arrange words in a probabilistic order that are grammatically correct and may b

> AI is an oracle just tells you what you're looking for. LLMs are oracles that arrange words in a probabilistic order that are grammatically correct and may be factually correct. Unfortunately there's no way to evaluate the probability of confabulation with any of the LLM chat bots. The distribution of occurrences confabulation is also not regular or predictable nor is it fixed. So you can't ever say "ChatGPT is bad at X" because it can be bad today, good tomorrow, then bad the next day.