3 ms·
Take a look at the chess engine Stockfish: they tossed out years and years of human written heuristics in board evaluation, to a small neural net that does the
by stabbles 3y ago
Take a look at the chess engine Stockfish: they tossed out years and years of human written heuristics in board evaluation, to a small neural net that does the same but better.
Now consider all the heuristics for inlining, loop unrolling, vectorization etc in compilers, certainly a neural net can be beneficial and possibly easier to maintain than tons of human written heuristics.
- asah 3y agobig +1 - IMHO the future of optimizers (and probably compilers...) are almost certainly ML-based.
- ldjkfkdsjnv 3y agoHumans designing algorithms by hand will go the way of the dodo bird
- YawningAngel 3y agoMy understanding is that stockfish retains and uses its classical evaluation model in addition to the NNUE model
- shpx 3y agoNo, they removed the code in Stockfish 16, released June 30, 2023 but it wasn't used for much or made much difference before then, after they introduced the neural net. https://github.com/official-stockfish/Stockfish/commit/af110e02ec96cdb46cf84c68252a1da15a902395 https://github.com/official-stockfish/Stockfish/commit/af110...
- owlbite 3y agoWe'll have to see. I could definitely see someone spending a lot of time training for a specific algorithmic kernel and microarchitecture and beating the best human results (by a few percent). I'd be very surprised if that can be extended to a large complex algorithmic system that is amenable to mathematical reformulations (at least within the next 10 years).
- hkmaxpro 3y agoAnother bitter lesson? http://www.incompleteideas.net/IncIdeas/BitterLesson.html http://www.incompleteideas.net/IncIdeas/BitterLesson.html