3 ms·
It's a 4x4 configuration of the separately available Xilinx/AMD AIE-ML accelerator, available on Xilinx alveo platform IIRC. VLIW vector units optimized for AI
by p_l 3y ago
It's a 4x4 configuration of the separately available Xilinx/AMD AIE-ML accelerator, available on Xilinx alveo platform IIRC.
VLIW vector units optimized for AI (-ML suffix) with runtime reconfigurable network on a chip letting you optimize "streaming" the data between individual cores.
The way "AMD IPU" device was implemented, which embeds the system in some new AMD CPUs, the previous drivers (which were Linux/RTOS only) didn't work.
I was actually in the middle of reverse engineering how it was exposed in Phoenix (7940hs) APUs to write custom driver for Linux based on the one shipped for windows.
- 3abiton 3y agoHow does it compare to cuda in terms of versatility and compatibility? most AI frameworks are built around cuda (pytorch, etc..) which is why nvidia has a monopoly now, I fail to see AMD breaking through, but one can hope. Do you see a light at the end of the tunnel?
- p_l 3y agoIt's targeting the high power efficiency part of the spectrum where nvidia is much less available. There's some reasonably capable software support, in fact the linux driver linked is significantly more capable than the "SDK" they released so far for windows. Which makes sense, because under Xilinx brand they have been selling accelerators and SoCs using AIE and AIE-ML cores for various use cases in embedded world, and XRT lets you program those with pretty much plain C++. For some AI tasks, they have provided high-end wrappers for models that use ONNX (iirc) so those can be used immediately. This is not ROCm, and has essentially none of the ROCm bullshit in terms of support. I seem to recall there's some work to integrate parts of ROCm (opencl, HIP) with XRT. Definitely going to build some kernels with this and test drive it ASAP.