4 ms·
I think this is a good casual introduction to the marketplace dynamics of how ML will impact the market. I do, however, disagree as I feel that this version of
by tysam_and 3y ago
I think this is a good casual introduction to the marketplace dynamics of how ML will impact the market. I do, however, disagree as I feel that this version of things is a bit too sterile, theoretical, and 'academic', and assumes a more open-information set of competitive strategies among potentially ideal agents from a game theoretic perspective. We can see this is absolutely not the case 'in real life'. To blatantly poke a bit of a (potential) hole in one of his examples -- Exxon-Mobil is one of the clearest examples of the monopolization-blobbification of power that I'd contend _does_ cause the very phenomenon that he's defending against.
An updated version: There will be a log-normally distributed set of winners and losers from the exponential effects of ML and 'AI', and the flatness of this curve will be almost entirely solely determined by the governance of the various countries in the world over different economic and/or informational policies. Other than that, the information asymmetry is going to make it a power-bloodbath as we go through our informational-industrial revolution.
While I'm here, while I think Hotz does contribute a lot of good to the field, though I do have a bit of an actual minor personal beef with him. He said he was going to reimplement https://github.com/tysam-code/hlb-CIFAR10 https://github.com/tysam-code/hlb-CIFAR10 in tinygrad, bashed a few parts of the code (my feelings!) for a while on stream, and then gave up a few hours later because of the empirical speed/occupancy numbers. >:( I want my fast reimplementation, George. Just do it.
- georgehotz 3y agolol, you should see me bash my own code. I'm even more mean. https://github.com/tinygrad/tinygrad/blob/master/examples/hlb_cifar10.py https://github.com/tinygrad/tinygrad/blob/master/examples/hl... have a bunch of bounties on it, we're getting 94%+ now! mostly not me who wrote this, see history. have to switch to float16 and add Winograd convs still. we have a branch with multigpu too. goal is to beat an A100 in speed on a tinybox.
- tysam_and 3y agoWell, you do seem to be extremely equal and fair on that aspect, so my respect to you for that. Don't be too hard on yourself, please! I'll keep an eye out on that, anyone working on it can shoot me a message if any snag or questions about particulars come up. Weirdly enough my email is best. If you're looking for biggest glaring performance the edge over PyTorch, I'd probably note that the MaxPooling is probably where to go, the PT version is extremely slow for some reason, and done properly it should be a simple indexing operation that's fusable in either direction. If whoever fulfills the bounty can beat me to me writing a custom mega-fused kernel with max pooling, the convs, activation, etc, then y'all have a pretty good shot at taking the WR crown.