3 ms·
It's not that perf is not important, but not having enough VRAM means you can't load the model of a given size at all. I'm not saying they shouldn't bother wit
by int_19h 4y ago
It's not that perf is not important, but not having enough VRAM means you can't load the model of a given size at all.
I'm not saying they shouldn't bother with RAM at all, mind you. But given some target price, it's a balance thing between compute and RAM, and right now it seems that RAM is the bigger hurdle.