3 ms·
I did small changes, took part of the Twitch sessions and thinking and understanding it. I contributed the main ideas for Kernel search, and was happy to get G
by xiphias2 3y ago
I did small changes, took part of the Twitch sessions and thinking and understanding it. I contributed the main ideas for Kernel search, and was happy to get George out of a mini depression with some quick fun wins. He almost gave it up, but now the progress every day is crazy.
The way to implement anything new and cool is to read it all first.
I love the way convolutions and matmuls are both expressed using ShapeTracker and simple mul operation for example. No other framework has that elegance.
Until you understand that part, it's not worth trying to change it.