3 ms·
Discrete GPUs are finished for AI. They've had years to provide the needed memory but can't/won't. The future of local LLMs is APUs such as Apple M series and
by wewewedxfgdf 2y ago
Discrete GPUs are finished for AI.
They've had years to provide the needed memory but can't/won't.
The future of local LLMs is APUs such as Apple M series and AMD Strix Halo.
Within 12 months everyone will have relegated discrete GPUs to the AI dustbin and be running 128GB to 512GB of delicious local RAM with vastly more RAM than any discrete GPU could dream of.
- throwaway314155 2y agoThat seems a tad dramatic. GPU's were widespread because of gaming, not AI. That the overlapping market would somehow just all magically have >3,000$ _and_ decide to switch to a non-standard, non-CUDA hardware solution in just 12 months is absurd.
- lvl155 2y agoFWIW GPUs still do not saturate PCIe lanes.