3 ms·
This is no more than Sturgeon's law (90% of everything is crap). Beyond that no, you cant do GPT-3 or Yolo or even MNIST[1][2] with a dumb heuristic. > almost
by paulsutter 5y ago
This is no more than Sturgeon's law (90% of everything is crap).
Beyond that no, you cant do GPT-3 or Yolo or even MNIST[1][2] with a dumb heuristic.
> almost everything produced by ML could have been produced, more cheaply, using a very dumb heuristic you coded up by hand, because mostly the ML is trained by feeding it examples of what humans did while following a very dumb heuristic
[1] https://en.wikipedia.org/wiki/MNIST_database https://en.wikipedia.org/wiki/MNIST_database
[2] http://vision.stanford.edu/cs598_spring07/papers/Lecun98.pdf http://vision.stanford.edu/cs598_spring07/papers/Lecun98.pdf