5 ms·
Yea it feels like transformer LLMs are in or getting closer to diminishing returns. Will need some new breakthrough, likely entirely new approach, to get to AGI
by mnemoni_c 3y ago
Yea it feels like transformer LLMs are in or getting closer to diminishing returns. Will need some new breakthrough, likely entirely new approach, to get to AGI levels
- Tubbe 3y agoYeah, we need radically different architecture in terms of the neural networks, and/or added capabilities such as function calling and RAG to improve the current sota
- mattsan 3y agocan't wait for LLMs to dispatch field agent robots who search for answers in the real world thats not online /s
- htrp 3y agoskynet would like a word