5 ms·
It's annoying I do LLMs for work and have a bit of an interest in them and doing stuff with GANS etc. I have a bit of an interest in games too. If I could get
by stuaxo 2y ago
It's annoying I do LLMs for work and have a bit of an interest in them and doing stuff with GANS etc.
I have a bit of an interest in games too.
If I could get one platform for both, I could justify 2k maybe a bit more.
I can't justify that for just one half: running games on Mac, right now via Linux: no thanks.
And on the PC side, nvidia consumer cards only go to 24gb which is a bit limiting for LLMs, while being very expensive - I only play games every few months.
- deleted 2y ago[deleted]
- wkat4242 2y ago32gb as of last night :)
- WaxProlix 2y agoThe new $2k card from Nvidia will be 32GB but your point stands. AMD is planning a unified chiplet based GPU architecture (AI/data center/workstation/gaming) called UDNA, which might alleviate some of these issues. It's been delayed and delayed though - hence the lackluster GPU offerings from team Red this cycle - so I haven't been getting my hopes up. Maybe (LP)CAMM2 memory will make model usage just cheap enough that I can have a hosting server for it and do my usual midrange gaming GPU thing before then.
- FuriouslyAdrift 2y agoUnified architecture is still on track for 2026-ish.
- sliken 2y agoGrace + Hopper, Grace + blackwell, and discussed GB10 are much like the currently shipping AMD MI300A. I do hope that a AMD Strix Halo ships with 2 LPCAMM2 slots for a total width of 256 bits.