4 ms·
I find Apple's performance with LLM's pretty exciting. At the very least, it promises that we don't be stuck on the vram pricing and capacities offered by AMD
by faeriechangling 3y ago
I find Apple's performance with LLM's pretty exciting. At the very least, it promises that we don't be stuck on the vram pricing and capacities offered by AMD and Nvidia to run local LLMs. We should see some big improvements in the near future as lpddr6 is around the corner and Apple has a big focus on GPU.