3 ms·
Don't most high-end machine learning solutions have more training data than a human could consume in a lifetime?
by Dylan16807 5y ago
Don't most high-end machine learning solutions have more training data than a human could consume in a lifetime?
- version_five 5y agoI don't think there is a realistic way to make that comparison. For consideration, our brains start with architecture and connections that have evolved over a billion years (give or take) of training. Then we are exposed to a lifetime of embodied experience coming in through 5 (give or take) senses. ML is picking out different things, but it's not obvious to me that models are actually getting more data then we have been trained on. Certainly GPT has seen more text, but I don't think that comparing that to a person's training is any more meaningful than saying we'll each encounter tens of thousands of hours of HD video during our training.