3 ms·
In the end an "idea" is by definition contrarian which is the opposite of the training objective of LLMs. The question is how far fine-tuning and tree-search ca
by WanderPanda 2y ago
In the end an "idea" is by definition contrarian which is the opposite of the training objective of LLMs. The question is how far fine-tuning and tree-search can go to extrapolate from the data-manifold. And the answer is probably not that far, currently.
- archagon 2y agoI’m personally not interested in using LLMs in my work, but I’d push back on this. A good idea can also synthesize a number of existing concepts into a new one, and LLMs appear to be well-suited to pattern recognition.