4 ms·
I'm hoping AMD wins when the RAM bubble bursts and their integrated AMD 395+ platform can keep getting faster and higher bandwidth.
by cyanydeez 3mo ago
I'm hoping AMD wins when the RAM bubble bursts and their integrated AMD 395+ platform can keep getting faster and higher bandwidth.
- bearjaws 3mo agoForget the 395+, I want the MI350P (or similar) long term. PCIe card is the way forward IMO, AI keeps changing so you don't want static hardware.
- petu 3mo agoHow PCIe card is better? "Static hardware" is still fully featured computer with lots of RAM, could be easily reused for other purposes.
- speed_spread 3mo agoThe unified memory architecture is interesting for toying with medium size models but will never offer as much bandwidth as a dedicated GDDR memory bank. Conversely, GDDR can't be used for general CPU purposes because access latency is just too high. Unless someones also comes up with dynamically programmable memory banks, something I'm not sure would even be possible.