3 ms·
What's your point? Parent said "That's literally useless knowledge" in response to not knowing the number of tokens in "blueberry". Are we talking about the spe
by strbean 1y ago
What's your point? Parent said "That's literally useless knowledge" in response to not knowing the number of tokens in "blueberry". Are we talking about the specific question or the general notion of counting?
The point is that LLMs don't speak / think in English. Asking them about spelling is like asking a Chinese speaker, during a text chat with translation, about English spelling. We can give the Chinese speaker access to an app to translate back to English so they can answer these questions. But they (the LLM) don't currently have access to that.
- dgfitz 1y ago> The point is that LLMs don't speak / think in English. They don't think or speak anything at all. They use a statistical model to predict the next most likely token to display in response to a prompt.
- strbean 1y agoDistinction without a difference. s/speak \/ think/operate/ If that makes you happy.
- dgfitz 1y agoThere is an enormous difference between claiming an LLM can think or use statistics to generate a token. All of the difference.
- strbean 1y agoIrrelevant to the discussion at hand + everyone knows what you mean when you refer to "how an LLM thinks" + prove the difference between one statistical process generating tokens (LLM) and another statistical process generating tokens (human brain) please.