3 ms·
> But whatever we have, it's clearly very different to an LLM. My only real quibble with your post is, again, that it seems different to an LLM. Current ML mod
by naasking 3y ago
> But whatever we have, it's clearly very different to an LLM.
My only real quibble with your post is, again, that it seems different to an LLM. Current ML models are still multiple orders of magnitude away from being on the same order of complexity as the human brain, and scaling doesn't yet seem to have hit a limit (more a data limit).
I just don't think we can draw such conclusions at this time.
- mike_hearn 3y agoSure, but what I'm getting at is that even if you scale a GPT-4 style transformer up 1000x, it won't suddenly develop a human-like memory. It will still be read only, whereas there's no such thing as a read only human unless they are unfortunate enough to have severe brain damage.