4 ms·
> iterate on their ideas I don’t think it’s clear that LLMs can have/express novel ideas. I would argue an LLM by definition cannot generate _novel_ ideas.
by akdev1l 2y ago
> iterate on their ideas
I don’t think it’s clear that LLMs can have/express novel ideas.
I would argue an LLM by definition cannot generate _novel_ ideas.
- kordlessagain 2y agoIn "Me" by Thomas T. Thomas, novel thinking came from introducing random retrieval of memories in the entity. With vector search, this might include singleton outliers added to the prompt.
- slowmovintarget 2y agoJust because the idea was expressed in science fiction, doesn't mean it's useful in the real world. Solving a non-trivial problem that hasn't been solved before is not something random walks on text token probabilities will get you. Text production algorithms have the problem of being unable to detect whether the text produced is internally consistent, let alone true in the logical sense. These two qualities are required for creating net new solutions to unsolved next-level problems.