4 ms·
AI is both software and hardware, which is why they spend a few refresh cycles improving the Apple Silicon Neural Engine, and are now releasing MLX since there
by minimaxir 3y ago
AI is both software and hardware, which is why they spend a few refresh cycles improving the Apple Silicon Neural Engine, and are now releasing MLX since there is better adoption.
- ActorNightly 3y agoThe thing is, parallel processing (i.e same instruction on multiple data pieces) is easy to implement for the most part in hardware. The issue is nobody wants to write low level software for a particular chip. Cuda is why NVIDIA is ahead despite AMD having comparable hardware. If you look at what its like to develop for MacOS or iPhone, its pretty clear that apple doesnt do this well. Even for their neural engine, I think you have to do some sort of entitlement thing to get code to run.