3 ms·
Are LLMs capable of any form of innovation or discovery that is not a simple mix of existing concepts? (It could be argued that all innovation or discovery is
by xyproto 3y ago
Are LLMs capable of any form of innovation or discovery that is not a simple mix of existing concepts?
(It could be argued that all innovation or discovery is a simple mix of existing concepts, but I don't believe this to be true).
- unsupp0rted 3y agoWhether they are or they aren't, we can get very far with discovery that is a simple mix of existing concepts
- xyproto 3y agoAbsolutely! And good science is sometimes just about organizing existing information too, which I believe LLMs can excel at.
- tracerbulletx 3y agoThe word "simple" is really loaded here. Is the universe a simple mix of existing physics? Is a 70B parameter matrix of numbers containing the relative relationships between a significant chunk of published human knowledge actually that simple?
- xyproto 3y agoSure, but I have yet to see LLMs actually innovate and not just pretend to be innovative.