3 ms·
To approximate a function with a loop you would need a close to infinitely large neural net. Humans do have loops in their thinking, we need a new architecture
by Jensson 3y ago
To approximate a function with a loop you would need a close to infinitely large neural net. Humans do have loops in their thinking, we need a new architecture for LLMs to be able to think in loops.
- thfuran 3y agoI don't think anyone would say that being an RNN disqualifies an architecture from being considered an LLM.
- Jensson 3y agoBut we don't know how to train those to be good yet. It would require some novel step there, and it is unclear if it would still be anything like current LLMs after that.