4 ms·
Pure LLM based approach will not lead to AGI, I'm 100% sure. A new research paper has shown [0] that no matter what LLM model is used, it exhibits diminishing r
by guitarlimeo 2y ago
Pure LLM based approach will not lead to AGI, I'm 100% sure. A new research paper has shown [0] that no matter what LLM model is used, it exhibits diminishing returns, when you would be wanting at least a linear curve when looking for AGI.
[0] https://www.youtube.com/watch?v=dDUC-LqVrPU https://www.youtube.com/watch?v=dDUC-LqVrPU
- sebzim4500 2y agoBased on the abstract this is about image models not LLMs
- guitarlimeo 2y agoAh fair point, should've read it more carefully. I'm tuning my probabilities back to 99%, I still don't believe just feeding more data to the LLM will do it. But I'll give the chance a possibility.
- DrSiemer 2y agoObviously feeding more data won't do anything besides increase the knowledge available. Next steps would be in totally different fields, like implementing actual reasoning, global outline planning and the capacity to evolve after training is done.