3 ms·

you do understand this would require re-training billions of weights in realtime and not even "trainingl really.... but a finished and stably functioning billi

you do understand this would require re-training billions of weights in realtime and not even "trainingl really.... but a finished and stably functioning billion+ param model updating itself in real time... good luck, see you in 2100 in short, what ive been shouting from a hilltop since about 2023: LLMs tech alone simply wont cut it; we need a new form of technology

jncfhnb 1y ago
You could probably argue that a model updating its parameters in real time is ideal but it’s not likely to matter. We can do that today, if we wanted to. There’s really just no incentive to do so. This is part of what I mean by encoding emotional state. You want standard explicit state in a simple form that is not a billion dimension latent space . The interactions with that space are emergently complex. But you won’t be able to stuff it all into a context window for a real GAI agent. This orchestration layer is the replacement for LLMs. LLMs do bear a lot of similarities to brains and a lot of dissimilarities. But people should not fixate on this because _human minds are not brains_. They are systems of many interconnected parts and hormones. It is the system framework that we are most prominently missing. Not raw intellectual power.