4 ms·
i guess it's that time of the week for my weekly response that de-hypes the buzzword hype: >but I feel like Apache TVM and the Various MLIR efforts (like Pytor
by mathisfun123 3y ago
i guess it's that time of the week for my weekly response that de-hypes the buzzword hype:
>but I feel like Apache TVM and the Various MLIR efforts (like Pytorch MLIR, SHARK, Mojo) are much more promising for ML inference
1. There is no PyTorch MLIR. There is torch-mlir but that is not a PyTorch sponsored/affiliated project.
2. MLIR has nothing to do with any of the issues that AMD is having with drivers because MLIR is about IR not drivers. Nor does it have anything to do with tinygrad because there is no mature autograd implementation in terms of MLIR (Polygeist, with all due respect, is not mature). So each of the projects you name-drop depends on some existing frontend that includes an autodiff implementation. I don't know how tinygrad works but if at some point they decide to lower their graph to MLIR (instead of their own kernels), there is no barrier/impediment (other than actually implementing the lowering).
3. Mojo is just a complete non-sequitur here; besides the fact that you might as well consider it vaporware until there's some release outside of their walled garden (sometime this month supposedly for the SDK), they expressly aim to target CPU rather than GPU.
I work on MLIR. I like MLIR. I hope MLIR succeeds bigly but it doesn't need to be shoe-horned into absolutely every single conversation about AMD/GPU/ML/LLM whatever.
- brucethemoose2 3y ago+1 I need to stop posting so late...