> The hardware support should be amazing for this I mean, caveat emptor; CoreML has been barebones for years, and Apple isn't exactly notorious for huge commit

> The hardware support should be amazing for this I mean, caveat emptor; CoreML has been barebones for years, and Apple isn't exactly notorious for huge commitment to third party APIs. The writing was on the wall with how Metal was rolled out and how fast OpenCL got dropped, it honestly doesn't surprise me at all at this point. Even the current Apple Silicon support in llama.cpp is fudged with NEON and Metal Shaders instead of Apple's "Neural Engine".