4 ms·
Which must be doing some heavy lifting. Humans ship with all the priors evolution has managed to cram into them. LLMs have to rediscover all of it from scratch
by ACCount37 10mo ago
Which must be doing some heavy lifting.
Humans ship with all the priors evolution has managed to cram into them. LLMs have to rediscover all of it from scratch just by looking at an awful lot of data.
- hathawsh 10mo agoOTOH, all that data is built on patterns that evolved from many years of evolution, so I think the LLM benefits from that evolution also.
- ACCount37 10mo agoSure, but LLMs are trying to build the algorithms of the human mind backwards, converge on similar functionality based on just some of the inputs and outputs. This isn't an efficient or a lossless process. The fact that they can pull it off to this extent was a very surprising finding.