2 ms·
You don't think it's useful to learn whether a model's "intelligence" generalizes beyond the tasks and modalities it is usually optimized for?
by user43928 5d ago
You don't think it's useful to learn whether a model's "intelligence" generalizes beyond the tasks and modalities it is usually optimized for?
- TylerE 5d agoAbsolutely not. Makes about as much sense as judging a car based on how good an airplane it makes.
- lumirth 5d agoHave you considered that the single most impressive breakthrough of LLMs as a technology is their ability to generalize beyond what they were explicitly trained on? Great analogy, pal, but LLMs aren't cars.
- user43928 5d agoI disagree. If GPT-7 can draw the Mona Lisa in MS Paint via computer use, this would be interesting. That it isn't the most efficient way to achieve the same end result is irrelevant.