3 ms·
Yes, they have a bunch of special model compilation stuff that needs to happen in order for the ML model to run on their hardware, such as weight quantization,
by pjscott 7y ago
Yes, they have a bunch of special model compilation stuff that needs to happen in order for the ML model to run on their hardware, such as weight quantization, and then they'd also need to generate the a program for the NPU so it knows what to do -- what to convolve with what, and so on.