4 ms·
I mean, yes but also no. JAX will JIT on accelerators OOTB and has outstanding (imho) support for multi node. Julia does not have that OOTB AFAIK. Now I agree
by the_svd_doctor 3y ago
I mean, yes but also no. JAX will JIT on accelerators OOTB and has outstanding (imho) support for multi node. Julia does not have that OOTB AFAIK.
Now I agree that Julia, with its JIT, is well positioned to do all this. But I don’t think it does.
- ssivark 3y agoAh, I see. There’s XLA.jl for TPUs and a bunch of stuff from the JuliaGPU organization for GPUs — I wonder how they compare with TF/PyTorch/JAX. I’m curious to get perspectives on what remains to be done to solve the missing piece, and what are the biggest challenges to overcome (assuming one gets access to the appropriate low level APIs on top of the hardware — like OpenAI’s Triton).
- patagurbon 3y agoXLA.jl is essentially abandoned, no funding IIRC. Coil.jl and maybe some future hypothetical work on MLIR.jl could bridge the gap pretty easily.