4 ms·
For context, in other Python ML packages like scikit-learn running the Intel extension on a compatable CPU can result in a massive performance increase. Althou
by minimaxir 4y ago
For context, in other Python ML packages like scikit-learn running the Intel extension on a compatable CPU can result in a massive performance increase.
Although since TensorFlow models should be trained on a GPU unlike sklearn, that's less useful, and there are better tools for CPU inference. (e.g. SavedModels or ONNX)
- make3 4y agoyes, but Intel now has mainstream GPUs that are reasonably (~ RTX 3060) performant, which is what I assume this is for
- Roark66 4y agoAre you talking about Intel Arc? I'm yet to see any ML relevant benchmarks on Intel Arc. If you are aware of any please let me know.
- throwaway1851 4y agoSame here. At 16GB of VRAM and only $349, it could fill a really nice slot for DL.
- tttttt5ts 4y agoYou won't for some time as ARC is only supported on Linux kernel 6+. And honestly, their hardware is pretty bad for ML given you can pick up a used 3090 for $600. I just don't think there will be an ML push for ARC with current gen.
- learndeeply 4y ago> And honestly, their hardware is pretty bad for ML given you can pick up a used 3090 for $600. How do you know it's bad? Do you have benchmarks? Just checked, used 3090s are going for $700-900 on eBay.
- doublepg23 4y agohardwareswap.reddit.com is the best way to buy used computer hardware.
- ShamelessC 4y agoIt won’t be able to make use of CUDA, which is more than enough reason.
- fulafel 4y agoI think a recent Linux version requirement shouldn't hamper benchmarking if you're a somewhat technical user. You can get the latest Linux pacakges for eg Ubuntu here: https://wiki.ubuntu.com/Kernel/MainlineBuilds https://wiki.ubuntu.com/Kernel/MainlineBuilds - probably other distributions have similar easy ways since it's needed so often in bug reporting for users to tell if a hw support bug is in a distro specific kernel change or not.
- gnufx 4y agoIt presumably has to support Aurora urgently: https://www.alcf.anl.gov/aurora https://www.alcf.anl.gov/aurora
- benreesman 4y agoI don’t know much about Intel’s toolchain: people say good stuff about TBB and things like that. Historically doing inference on Intel gear was mostly about whether or not to target AVX2 or AVX512 when building Eigen or whatever. A few years ago the net win was AVX2 because the de-clock and re-clock just killed you. What’s the game these days? Long term I doubt inference will be done on x86, but I think a lot of people still do it.