4 ms·
We've always been in the brute force phase of AI. Much of AI is throw things at the wall and see what sticks.
by lores 2y ago
We've always been in the brute force phase of AI. Much of AI is throw things at the wall and see what sticks.
- dartos 2y agoI mean that how machine learning works, right? Millions or billions of iterations to tune some algorithms to output some data which satisfies a success metric.
- danielmarkbruce 2y agoAI should be renamed "Brute Force Statistical Computing". BFSC. It is what it is.
- nick3443 2y agoIt's stochastic gradient descent, so slightly better than blind brute force
- danielmarkbruce 2y agoThere are various optimizers... but sure, it's slightly better than brute force. SBTBFSC.
- lores 2y agoIndeed, and "hyperparameter tuning", i.e. "try every combination but give that an impressive name so people don't raise their eyebrow at us"
- marcosdumay 2y agoThere's nothing on machine learning that makes convergence inherently hard. And there's certainly something we are doing wrong that makes it so data-intensive.
- dartos 2y agoI think we need so much data for deep learning because of the sheer number of parameters in these models. On the order of 100s of billions