2 ms·
>the other camp defines learning as some kind of infinite information compression like being able to add any two numbers no matter how large, which is something
by voiper1 4y ago
>the other camp defines learning as some kind of infinite information compression like being able to add any two numbers no matter how large, which is something no language model will ever be able to do.
I know this isn't strictly an LLM, but can't there be an "extension" that the LLM learns a formula and how to plug values into it (it already seems pretty good at explaining code, so it can already do this) and then new: the ability to actually perform the calculation - execute the code/formula or at least "use a calculator" with the values.
- simonh 4y agoThe paper addresses the same idea, using the same example. Sure, that can be done. I suppose it’s a case of evaluating the prompt and then selecting from various different mechanisms for generating a response, one or several of which might be an LLM. That’s interesting but really out of open for a discussion if LLMs themselves though.