2 ms·
So the M3 Ultra is amazing value then. And from what I could tell, an equivalent AMD Epyc would still be so constrained that we're talking 4-5 tokens/s. Is this
by sgt 2y ago
So the M3 Ultra is amazing value then. And from what I could tell, an equivalent AMD Epyc would still be so constrained that we're talking 4-5 tokens/s. Is this a fair assumption?
- Aeolun 2y agoThe Epyc would only set you back $2000 though, so it’s only a slightly worse price/return.
- adgjlsfhk1 2y agoNo. The advantage of Epic is you get 12 channels of ram so it should be ~6x faster than a consumer cpu.
- sgt 2y agoI realize that but apparently people are still getting very low tokens/sec on Epyc. Why is that? I don't get it, as on paper it should be fast.