3 ms·
I thought LLMs are text generators, and for images and music there are separate models. Anyway, the argument was that cognition is limited to text.
by akomtu 2y ago
I thought LLMs are text generators, and for images and music there are separate models. Anyway, the argument was that cognition is limited to text.
- ninetyninenine 2y agoNo. LLMs can take any type of data. Text is simply a string of symbols. Images, video and music are also a string of symbols. The model is the same algorithm just trained on different types of data. I never said cognition was limited to text. I just limited the topic itself to cognition involving text.
- ben_w 2y agoI find the terminology is used inconsistently*, so it's probably always worth asking. To me, a "large language model" is always going to mean "does text"; but the same architecture (transformer) could equally well be trained on any token sequence which may be sheet music or genes or whatever. IIRC, transformers aren't so good for image generators, or continuums in general, they really do work best where "token" is the good representation. * e.g., to me, if it's an AI and it's general then it's an AGI, so GPT-3.5 onwards counts; what OpenAI means when they say "AGI" is what I'd call "transformative AI"; there's plenty of people on this site who assert that it's not an AGI but whenever I've dug into the claims it seems they use "AGI" to mean what I'd call "ASI" ("S" for "superhuman"); and still others refuse to accept that LLMs are AI at all despite coming from AI research groups publishing AI papers in AI journals.