3 ms·
NPUs are actually incredibly fast for standard inference operations. This benchmark is horribly flawed in many ways, and was so evidently useless that I'm surp
by llm_nerd 2y ago
NPUs are actually incredibly fast for standard inference operations.
This benchmark is horribly flawed in many ways, and was so evidently useless that I'm surprised that they still decided to "publish" this. When your test gets 1% of the published performance, it's a good indication that things aren't being done correctly.