3 ms·
Eh perhaps poor choice of words. It works fine for crypto but LLM performance is far more sensitive to bandwidth. You lose a ton of performance if you’ve got P
by Havoc 2y ago
Eh perhaps poor choice of words.
It works fine for crypto but LLM performance is far more sensitive to bandwidth. You lose a ton of performance if you’ve got PCIe in the loop, never mind one lane pcie. That’s why nvlink is (was) a thing - trying to cut that out entirely.
- system2 2y agoGot it. I was planning to switch my miners to LLM farm. I will test and see how much of a difference it will make. Thanks.