3 ms·
There's always AMD/ATI with its completely open drivers and hardware. AMD even redesigned the silicon to isolate HDCP from rest of the core to be able to open
by bayindirh 6y ago
There's always AMD/ATI with its completely open drivers and hardware.
AMD even redesigned the silicon to isolate HDCP from rest of the core to be able to open video encoders and other HDCP facing hardware to open drivers.
Also, AMD's open driver's written by a different team in AMD. So they're not exactly 3rd party drivers.
- 3np 6y agoFor how long, though? https://www.arm.com/company/news/2020/09/nvidia-to-acquire-arm https://www.arm.com/company/news/2020/09/nvidia-to-acquire-a...
- zamalek 6y agoAnd hopefully AMD has good news on the 28th.
- modeless 6y agoUnfortunately AMD totally missed the boat on ML. They need to dramatically increase their investment both in hardware and software. My impression in the past has also been that they lag in performance on the high end, and their OpenGL driver quality is not as good in terms of features and conformance either. Though I am not totally up to date on their latest stuff.
- BearOso 6y agoThe OpenGL quality problems are strictly on the Windows side. The open-source OpenGL drivers are very good.
- dragontamer 6y agoI don't think any company, aside from NVidia, is working on FP16 Tensor cores. Not Intel, not AMD. Google has a systolic processor for tensor units, but that's cloud only. I know ML is where the current money is at, but coprocessors in general seem to be applicable to far more problems than just machine learning and graphics.
- bayindirh 6y agoJust food for thought: What if AMD actually acquires Xilinix? Everybody thought it's about CPU-FPGA integration but, they may pull something very, very different.
- dragontamer 6y agoI'm not an expert on Xilinx's stuff, but Xilinx's 18-bit x 27-bit multiplier DSP48 architecture still seems quite awkward to me. https://www.xilinx.com/support/documentation/white_papers/wp486-deep-learning-int8.pdf https://www.xilinx.com/support/documentation/white_papers/wp... True, a systolic processor can be built out of these components, but I doubt it'd be anything as fast as a proper matrix-multiplication unit that NVidia is putting out. And that's after the complications associated with FPGA programming. ---------- Xilinx's FPGAs are a combination of LUTs (4-bit or 6-bit look-up tables), Routing, and "DSP Slices" (prefabricated multipliers). The bulk of your math is still going to be performed in the DSP Slice. Where FPGAs win is that their LUTs and Routing tables allow you to create custom high-speed glue-logic between these DSP slices. But when it comes to something like a regular Convolutional neural net, the routing is very straightforward. ------ I'm not really a deep learning expert. I know that FP16 seems to be pushed by NVidia. This INT8 stuff seems odd to me (there's no way INT8 gets the same dynamic range as FP16), but I'm also not really sure if the dynamic range is needed or useful in deep learning applications.
- klyrs 6y agoI've done some systolic processors on Xilinx hardware. It's really dang hard, on their biggest, fanciest chips, to pump the DSPs at anything close to their advertised clock speeds. Maybe if I was smarter, I could do an asynchronous design that would somehow avoid clocking issues, but I suspect that doing async between mismatched clock regions would effectively halve the clock (and that might be optimistic). The only consolation for me is that I/O over PCI ends up being my ultimate bottleneck. If AMD did a full-on integration with their infinity fabric, it could actually be a game changer. For me, in my weirdo niche.
- StillBored 6y agoUnfortunately AMD totally missed the boat on ML. I think by this measure so did everyone else. Nvidia pushed cuda, and everyone took it, even though 8 or so years ago openCL was a reasonable competitor. But various orgs choose to make a proprietary technology a first class citizen rather than putting the effort into an open alternative. Big win for nvidia, big loss for everyone else not large enough to create their own ML frameworks and accelerators.
- dragontamer 6y agoIts not really about CUDA or OpenCL. Its about the choice to support FP16 matrix-multiplication at the assembly level of NVidia chips. When you build a processor that literally has "do 4x4 matrix multiplication" as an assembly statement, you'll get far superior ML performance compared to everyone else. (Except Google's TPUs, which have larger matrix-multiplication arrays)
- loosescrews 6y agoOpen source is great, but AMD is not a good example of how to do open source right. AMD's drivers are often not usable in released kernels until many months after hardware is released. For example, AMD is just now adding initial support for their new GPUs [1]. From what I have read, good support for AMD's previous generation is only now getting to distributions. Intel on the other hand typically has their drivers in released kernels long before their hardware is released. Intel's New GPUs haven't been released yet, but they first started adding support in early 2019 [2]. I can't find it now, but I remember hearing a story about Intel removing drivers from the kernel tree for some hardware that they cancelled. If you want to use a modern high-end GPU in Linux, your only real choice continues to be Nvidia. Their drivers are not open source, but at least they work at launch (except maybe with a 5.9 kernel?). This is why Intel entering into the high-end GPU space is so exciting. Soon we may have a high-end option with good open source drivers while the part is still high-end. [1] https://www.phoronix.com/scan.php?page=news_item&px=Linux-5.9-Released https://www.phoronix.com/scan.php?page=news_item&px=Linux-5.... [2] https://www.forbes.com/sites/jasonevangelho/2019/02/18/intel-already-adding-linux-kernel-support-for-2020-dedicated-gpu-releases/ https://www.forbes.com/sites/jasonevangelho/2019/02/18/intel...
- sce 6y agoThis comment is very weird. For Linux users it is definitely better buying an AMD discrete graphics card than Nvidia, and it has been for an eternity. Just google "torvalds Nvidia" as an example of how the community feels about Nvidia. Is it even possible using Nvidia cards with Wayland? Nvidia has a history of problems in Linux. I can still remember having to log out of my X session just to change monitor layout; which is something you do alot with a laptop and external displays. Took them several years to fix! I've experienced intel boards where I had trouble getting anything but the newest fedora with custom kernel parameter to even get the installer running. But most of the time intel has very good upstream support, so it is normally a pretty safe bet. With AMD there are sometimes delays getting full support for a new generation upstreamed (e.g. hdmi audio and such), so it is usually good to Google for Linux reviews first. In general AMD has superb open source support for their cards, if not immediately at launch, and I recommend them for Linux users who want the least amount of hassle. I've seen people recommending Nvidia to Linux on YouTube (and now here), and I honestly think it's a disfavor to anyone interested in Linux.