3 ms·
The latest LLMs (except Qwen and DeepSeek) are MLLMs (multimodal language models). Unless you count RGB values as symbols, they are dealing with more than symbo
by red75prime 2mo ago
The latest LLMs (except Qwen and DeepSeek) are MLLMs (multimodal language models). Unless you count RGB values as symbols, they are dealing with more than symbols.
Yes, there are functional gaps between MLLMs and humans. Their long-term memory is an external mechanism that can use RAG-like approaches, context compression or something like that. The models have problems managing those.
The models can't do continual learning. Although there are promising directions (expert cloning in MoE models, and others).
The only mode of learning available to a model while working on a task is in-context learning. This limits the models to concepts that they developed during autoregressive pretraining and the later stages of training. That is a model can't create new concepts as a result of working on a task (the model's maintainers could choose the task to be represented in the training data later though).
But it's all about functionality.
I guess you have the Leibniz's mill intuition. We can look at how those things work, and there are no experiences or intelligence in sight.
- mythrwy 2mo agoIt could be the mill intuition, but my thought is nothing along the lines of "computers can't have souls!" or the human mind is supernatural or anything of the sort. It's gaps in actual thinking or intelligence I notice. A diff between what I can see or understand and what the model sees or understands. Some are very big, and this in spite of the models having much more knowledge and (presumably) less error prone processing. My thought is that part of it has to do with inherent limitations of using symbolic representation for "thinking" and I suppose humans have other forms of thinking that occur outside of symbolic representation, and that is going to be hard to recreate digitally. This is my whole point and I'm not trying to win a debate here or prove "LLMs are useless". Just speculating.