3 ms·
It’s less size of model and more mem throughout and npu tops that’s the limiting factor for this class of device Which means you can do larger but it’ll become
by Havoc 2y ago
It’s less size of model and more mem throughout and npu tops that’s the limiting factor for this class of device
Which means you can do larger but it’ll become ever slower