3 ms·
Data science where you need to keep ~50GB of data in RAM and do intensive things with it (e.g. loop over it repeatedly with numba). You can't get use out of mor
by energy123 1y ago
Data science where you need to keep ~50GB of data in RAM and do intensive things with it (e.g. loop over it repeatedly with numba). You can't get use out of more than 4 cores because memory bandwidth is the only limitation. The data is too big for AMD's cache to be a factor.
Threadripper is built for this. But I am talking about the consumer options if you are on a budget. Intel has significantly more memory bandwidth than AMD in the consumer end. I don't have the numbers on hand, but someone at /r/localllama did a comparison a while ago.
- Marsymars 1y agoFramework Desktop?
- exceptione 1y agoThis? https://old.reddit.com/r/LocalLLaMA/comments/1ak2f1v/ram_memory_bandwidth_measurement_numbers_for_both/ https://old.reddit.com/r/LocalLLaMA/comments/1ak2f1v/ram_mem... I can't see how that supports your conclusion.
- energy123 1y agoThere's many red herrings in that table (namely: old DDR4 consumer platforms, server platforms, low bandwidth DDR5 sticks), but surfacing the two relevant numbers (DDR5-6400 consumer heads-up comparison): > AMD 7900X - 68.9 GB/sec > Intel 13900K - 93.4 GB/sec That's 35% better.