4 ms·
An LLM is not a program, it's a static data structure consisting of a big bunch of numbers, and as such it cannot be run as it doesn't execute instructions or h
by hippietrail 14d ago
An LLM is not a program, it's a static data structure consisting of a big bunch of numbers, and as such it cannot be run as it doesn't execute instructions or have a program counter. It is correct that the LLM itself isn't doing anything for this reason.
LLMs are more like the neurons. The rest of what you're describing is not the LLM but the inference engine that does many lookups into the model and performs calculations outside the model.
Brains do actually do the inference part as well as containing the data structure.