4 ms·
Does this mean you could fit its whole working set in the cache hierarchy of a modern high end GPU getting near 100% ALU utilisation?
by crest 3y ago
Does this mean you could fit its whole working set in the cache hierarchy of a modern high end GPU getting near 100% ALU utilisation?
- Tuna-Fish 3y agoIt streams the weights. This is going to be what limits performance, not alu utilization.