3 ms·
The "inteligence" level is extremely hard to gauge overall since humans typically have a very deep understanding of a handful of topics, with lots of repetition
by moffkalast 3y ago
The "inteligence" level is extremely hard to gauge overall since humans typically have a very deep understanding of a handful of topics, with lots of repetition and knowledge distillation while learning.
Whereas current LLM training focuses on getting as much diverse data as possible and training for very few epochs, so the inteligence we get is wider than any human could ever hope to achieve, but is also shallow in its understanding of each topic. Combining all fields of knowledge together does have its benefits in solving certain problems though.