3 ms·
Why is it less impressive?
by insanitybit 3y ago
Why is it less impressive?
- runarberg 3y agoI would say creating a model which is able to interpolate from training data in a way which produces an accurate output of a new input is a little impressive (if only as a neat party trick), however anybody can run a python interpreter on a server somewhere. I’m sure there are use cases for this. But in the end it is only a simple feature added onto a—sometimes—marginally related service.
- insanitybit 3y agoHm, I don't think of it that way I guess. What the LLM is doing is generalizing a problem based on previous problems it has seen and then offloading the execution of that problem to a machine with some defined, specific semantics. This is a lot more than a party trick. The model is able to describe the program it wants to execute and now it can accurately execute that - that it 'offloads' the work to a specialized program seems fine to me. It's way more than a simple feature, this is enabling it to overcome one of the biggest limitations and criticisms of LLMs - it can answer questions it has never seen before.