3 ms·
How does that explain why the tokens for strawberry, melon and "Stellaberry" [1] are close to each other? [1] Suggestion from chatgpt3.5 for new fruit name.
by abdullahkhalids 2y ago
How does that explain why the tokens for strawberry, melon and "Stellaberry" [1] are close to each other?
[1] Suggestion from chatgpt3.5 for new fruit name.
- roywiggins 2y agoIlliterate humans can come up with new words like that too without being able to spell, LLMs are modeling language without precisely modeling spelling.