Your example highlights the issue! Chat GPT isnt even giving "precise answers". Its just presenting the next best token. It would do the same thing if the tok

Your example highlights the issue! Chat GPT isnt even giving "precise answers". Its just presenting the next best token. It would do the same thing if the tokens were converted to another set of symbols instead of ASCII/UTF. The fact that the tokens happen to look like english, and that combinations of english have meaning.. not really a concern to the token generator. Its never inaccurate - its always mathematically faithful. Its just created the next token to suffice its reward function. And No reward function can magically tell you what reality is* We can discuss this on HN though. In reality, there are enough managers and CEOs who are planning to do silly things with Gen AI. To survive those conversations, this idea of "thinking system in a server" needs to go. ---- If some code can do that, we could just give up on science entirely and let the algorithm solve everything for us.