4 ms·
>MKL has faster routines and is completely free, but it won't work on ARM. It will probably be ported though, if there's a demand...
by coldtea 6y ago
>MKL has faster routines and is completely free, but it won't work on ARM.
It will probably be ported though, if there's a demand...
- stabbles 6y agoMKL is heavily optimized for Intel microarchs and purposely crippled on AMD (I believe dgemm is fast, sgemm slow). I don't think MKL benefits from optimizing it for Apple Silicon, especially considering Apple ditched Intel's hardware.
- fxtentacle 6y agoNo it won't. Mkl is an Intel toolkit, so they will surely not support Apple's move to dump Intel processors.
- pinewurst 6y agoIn what world will Intel port MKL - Intel intellectual property - to ARM? The whole purpose of Intel's software tools is as an enabler and differentiator for their architecture and specifically their parts.
- coldtea 6y agoIn a world where Intel already had licensed ARM and built it in the past: https://newsroom.intel.com/editorials/accelerating-foundry-innovation-smart-connected-world/#gs.kn9elz https://newsroom.intel.com/editorials/accelerating-foundry-i...
- chipotle_coyote 6y agoThat linked article from 2016 is about Intel's Custom Foundry program, which I'm fairly sure is for building chips under contract to other companies. It promotes that they have "access to ARM Artisan IP," but doesn't specifically mention an ARM version of MKL that I see. The list of compatible hardware Intel's page on MKL itself lists compatible processors and ARM is conspicuously absent: https://software.intel.com/content/www/us/en/develop/tools/math-kernel-library.html https://software.intel.com/content/www/us/en/develop/tools/m... And, this question on Intel's own forums from 2016 at least suggests that there wasn't an MKL version for ARM in the time frame of the article you're linking to, either: https://community.intel.com/t5/Intel-oneAPI-Math-Kernel-Library/MKL-gfortran-on-ARM-processors-e-g-Raspberry-Pi-3-quad-core/td-p/1086157 https://community.intel.com/t5/Intel-oneAPI-Math-Kernel-Libr... So, from what I can tell, while Intel is an ARM licensee and made ARM CPUs in the past, they haven't made their own ARM CPUs for years and there's no sign they ever made MKL for any ARM platform. Never say never, but I think the OP is basically right -- there's not a lot of incentive for Intel to produce one.
- dfox 6y agoIntel had sold most of the relevant ARM IP and product lines to Marvell in 2006.
- Fnoord 6y agoI don't know about this proprietary technology specifically, but Intel is a huge company with some FOSS friendliness. USB 4 is based on Thunderbolt 3, so I guess they licensed that one.
- loosescrews 6y agoMaybe, but note that this is the Intel MKL. A library developed and maintained by Intel. It is not a secret that Intel does this to support their ecosystem and have been caught intentionally crippling support for AMD processors in the past [1]. Intel has recently been adding better support for AMD processors [2], but many suspect that is intended to help x86 as a whole better compete with ARM. If it does get ported, it is highly unlikely to have competitive performance. [1] https://news.ycombinator.com/item?id=24307596 https://news.ycombinator.com/item?id=24307596 [2] https://news.ycombinator.com/item?id=24332825 https://news.ycombinator.com/item?id=24332825
- kxyvr 6y agoThanks for the links. If anyone is wondering about some of the hoops that need to be jumped through to make it work, here's another guide [1]. One question in case you or anyone else knows: What's the story behind AMD's apparent lack of math library development? Years ago, AMD and ACML as their high-performance BLAS competitor to MKL. Eventually, it hit end of life and became AOCL [2]. I've not tried it, but I'm sure it's fine. That said, Intel has done steady, consistent work on MKL and added a huge amount of really important functionality such as its sparse libraries. When it works, AMD has also benefited from this work as well, but I've also been surprised that they haven't made similar investments. Also, in case anyone is wondering, ARM's competing library is called the Arm Performance Libraries. Not sure how well it works and it's only available under a commercial license. I just went to check and pricing is not immediately available. All that said, it looks to be dense BLAS/LAPACK along with FFT and no sparse. [1] https://www.pugetsystems.com/labs/hpc/How-To-Use-MKL-with-AMD-Ryzen-and-Threadripper-CPU-s-Effectively-for-Python-Numpy-And-Other-Applications-1637/ https://www.pugetsystems.com/labs/hpc/How-To-Use-MKL-with-AM... [2] https://developer.amd.com/amd-aocl/ https://developer.amd.com/amd-aocl/
- danieldk 6y agoEventually, it hit end of life and became AOCL [2]. I've not tried it, but I'm sure it's fine. It's ok. I did some experiments with transformer networks using libtorch. The numbers on a Ryzen 3700X were (sentences per second, 4 threads): OpenBLAS: 83, BLIS: 69, AMD BLIS: 80, MKL: 119 On a Xeon Gold 6138: OpenBLAS: 88, BLIS: 52, AMD BLIS: 59, MKL: 128 OpenBLAS was faster than AMD BLIS. But MKL beats everyone else by a wide margin because it has a special batched GEMM operation. Not only do they have very optimized kernels, they actively participate in the various ecosystems (such as PyTorch) and provide specialized implementations. AMD is doing well with hardware, but it's surprising how much they drop the ball with ROCm and the CPU software ecosystem. (Of course, they are doing great work with open sourcing GPU drivers, AMDVLK, etc.)