4 ms·
The majority of the data is a web crawl. It's not curated in the slightest and includes the whole of reddit. In contrast the data we collect through our nervou
by teruakohatu 4y ago
The majority of the data is a web crawl. It's not curated in the slightest and includes the whole of reddit.
In contrast the data we collect through our nervous system is rich and meaningful and far deeper than just raw text. We can even manipulate the environment as we learn to facilitate faster learning eg. pick up a ball and throw it, rather than just watch videos of balls being thrown.
- z3c0 4y agoThe web crawling is curation, as even the most mundane entries into the dataset will still have a significant weight on the model, even if it's small. What separates the brain from any statistics-driven model is how well it swims through an ocean of information to find the relevant details, tossing out what's left, and filling in gaps with intuition. Sure, its messy process, and mistakes get made, but that's in stark contrast to the very trim way that ML models run.