2 ms·
Nope. PyCuda is writing inline C cuda and hardly integrated with python. Julia has four layers of GPU abstractions, each being successively easier to use ( bi
by dklend122 6y ago
Nope. PyCuda is writing inline C cuda and hardly integrated with python.
Julia has four layers of GPU abstractions, each being successively easier to use ( bit a bit less control. ), all in pure Julia and reusing the compiler and normal Julia abstractions and integrated with AD etc
CUDA.JL, GPUArrays.jl, kernelabstracions.jl, tullio.jl.
At the highest levels you just write normal loops or index notation and the code and backward pass generated. Also generic to backend-simd and multithreading cpu and soon AMD rock, intel accelerator and distributed
This all composed with deep learning libs etc