4 ms·
I believe “learn any distribution of data” is his attempt at describing the Universal Approximation Theorem to the laymen.
by acchow 2y ago
I believe “learn any distribution of data” is his attempt at describing the Universal Approximation Theorem to the laymen.
- danielmarkbruce 2y agoAlmost certainly true, and all the people crapping all over his description should really take a step back and consider that. He isn't out on some island all by himself here.
- debugnik 2y agoUniversal approximation doesn't mean we've got (or ever will) algorithms to learn good enough models for any problem and the resources to run them, just that those models conceptually exist.
- danielmarkbruce 2y agoIf you read what he wrote closely, he doesn't claim what you just claimed. Read it word for word: "humanity discovered an algorithm that could really, truly learn any distribution of data (or really, the underlying “rules” that produce any distribution of data). To a shocking degree of precision, the more compute and data available, the better it gets at helping people solve hard problems" He's an optimistic guy, no doubt, but he isn't full of shit.