2 ms·
> I think Apple will come up with some crazy hardware to run good quality LLMs. you mean like the "neural engine" that has been present in their SoCs for nearl
by LoganDark 3y ago
> I think Apple will come up with some crazy hardware to run good quality LLMs.
you mean like the "neural engine" that has been present in their SoCs for nearly a decade? (this is also why M1/M2s can run LLMs at comparable speeds to desktop GPUs... and they weren't even designed with LLMs in mind yet)