3 ms·
Faster or not, API availability with no BS FW blobs or tooling and direct to hardware access will be winner here, otherwise no one will be able to program for t
by diimdeep 2y ago
Faster or not, API availability with no BS FW blobs or tooling and direct to hardware access will be winner here, otherwise no one will be able to program for this chips.
Here is some grounded discussion I could find about AMD Ryzen AI NPU programming https://github.com/ggerganov/llama.cpp/issues/1499 https://github.com/ggerganov/llama.cpp/issues/1499
From there, here is list of Ryzen AI engine enabled laptop/mini PC models https://github.com/amd/RyzenAI-SW/issues/18 https://github.com/amd/RyzenAI-SW/issues/18
gather all that, I wonder how on earth these benchmarks comparing oranges to apples.