4 ms·
I mean, this is to be expected right, the LLMs are operating at a scale of billions (trillions) of parameters, so it's impossible to explain how every single st
by samspenc 2y ago
I mean, this is to be expected right, the LLMs are operating at a scale of billions (trillions) of parameters, so it's impossible to explain how every single step or response works.
Overall, people can grasp what an LLM does at a high level. But to debug exactly why an LLM gives a specific response to a specific query, one would have to debug hundreds of billions of parameters.
- reducesuffering 2y agoHence one class of problems. GPT-5 will have probably an order of magnitude more parameters to debug. If you get more capable systems that "do X" but they didn't interpret X right, and you don't know why they're doing Y to get to X, you didn't even know they could do Y to get X, and they're getting very powerful...
- fuzzfactor 2y ago>one would have to debug hundreds of billions of parameters. That could be unsurmountable, probably requires a computer to do anything of the sort !