Apple Silicon is surprisingly a good approach here - * On CPU: SIMD NEON * On CPU: custom matrix multiply accelerator, separate from SIMD unit * On CP

Apple Silicon is surprisingly a good approach here - * On CPU: SIMD NEON * On CPU: custom matrix multiply accelerator, separate from SIMD unit * On CPU package: NPU * GPU Then they go and hide it all in proprietary undocumented features and force you to use their framework to access it :c