4 ms·
Also negative 50gbps on memory speed
by MikusR 3y ago
Also negative 50gbps on memory speed
- MikusR 3y agoI was wrong, it's minus 50GB/s
- drBonkers 3y agoDoes that have a big impact on use-feel if you aren't doing data-write intensive tasks?
- sbierwagen 3y agoLLM inference speed is bandwidth limited.