3 ms·
True but the machinery (is the brain) that enables humans to acquire/process/understand that knowledge is a lot more complex and went through years of environme
by flashgordon 4y ago
True but the machinery (is the brain) that enables humans to acquire/process/understand that knowledge is a lot more complex and went through years of environmental conditioning?
- lisper 4y agoYes, but that environmental conditioning did not involve training on the contents of the Kindle library. And the results of that training are encoded in under a gigabyte. For the record, I'm not saying LLMs are not a huge step forward. They are. But they are not -- and cannot be -- the whole answer.
- GaggiX 4y agoI think the human brain is naturally predisposed to learn a language, an evolutionary bias. That helps tremendously compared to a tabula rasa.
- sgu999 4y agoIf we are going in that direction, I guess the few million years of evolution should also count
- flashgordon 4y agoNo totally. Not an ml guy by long shot. My understanding is llms are foundational models which iiuc are "base" models representing all human knowledge until some point in time. Now I'd argue that you don't have to count all of evolution but just the point from when you were born. I'd say the all the sensory experiences + knowledge input from the day a brain is activated (DOB) would be in the order of PBytes if not more?