3 ms·
Humans have experienced an amount of data that absolutely dwarfs the amount of data even the largest of LLMs have seen. And they've got billions of years of evo
by gaganyaan 3y ago
Humans have experienced an amount of data that absolutely dwarfs the amount of data even the largest of LLMs have seen. And they've got billions of years of evolution to build on to boot
- bombolo 3y agoYou're straying away. Let's talk about learning C. Also humans didn't evolve in billion of years.
- gaganyaan 3y agoThe process of evolution "from scratch", i.e. from single-celled organisms took billions of years. This is all relevant because humans aren't born as random chemical soup. We come with pre-trained weights from billions of years of evolution, and fine-tune that with enormous amounts of sensory data for years. Only after that incredibly complex and time-consuming process does a person have the ability to learn from a few examples. An LLM can generalize from a few examples on a new language that you invent yourself and isn't in the training set. Go ahead and try it.
- bombolo 3y agoI can't even convince it to put the parameters in a function call in the correct order, despite repeatedly asking.