4 ms·
Maybe you should look at the code base before throwing a tantrum on a hacking blog. Try adding a new feature to Tensorflow / PyTorch, do the same for TinyGrad
by xiphias2 3y ago
Maybe you should look at the code base before throwing a tantrum on a hacking blog.
Try adding a new feature to Tensorflow / PyTorch, do the same for TinyGrad and you won't have this question anymore.
- voz_ 3y agoPytorch is pretty easy to add stuff to.
- sakras 3y agoJust curious, have you tried adding a feature to TinyGrad? Or are you arguing in the abstract because TinyGrad is small? Because I personally have tried, and found the code to be so code-golf and spaghetti-like that I gave up, it just wasn’t worth my time (even for the $1000 bounty).
- xiphias2 3y agoI did small changes, took part of the Twitch sessions and thinking and understanding it. I contributed the main ideas for Kernel search, and was happy to get George out of a mini depression with some quick fun wins. He almost gave it up, but now the progress every day is crazy. The way to implement anything new and cool is to read it all first. I love the way convolutions and matmuls are both expressed using ShapeTracker and simple mul operation for example. No other framework has that elegance. Until you understand that part, it's not worth trying to change it.