3 ms·
This seems like saying "Synonyms are a big reason that humans fall short." Part of what makes AI interesting is that it can understand a huge number of differe
by kevincox 2y ago
This seems like saying "Synonyms are a big reason that humans fall short."
Part of what makes AI interesting is that it can understand a huge number of differently phrased data. It seems like different token encodings would only be a very minor complexity compared to the variety of human language.
- darby_nine 2y ago> Part of what makes AI interesting is that it can understand a huge number of differently phrased data. I'd say it "recognizes" a huge number of differently phrased data. This avoids implying any analytic encoding.
- Kiro 2y agoI don't like that. "Recognizes" implies that it only works because it has seen exactly that before but I can throw data in a completely made-up format that the world has never seen at an LLM and tell it to convert it to another format and it does so with no problems.
- darby_nine 2y ago> "Recognizes" implies that it only works because it has seen exactly that before I don't think we use it that way with humans either. We also are capable of recognizing features (patterns) from formally new data.
- bjourne 2y agoThe smaller the tokens the more guesses the LLMs need for generating text. LLMs are really good at guessing, but the more they have to guess the likelier for them to lose their train off thought.