3 ms·
We're in a much better place with the 7900 cards now having a hardware accelerator for FP16 and BF16 precision. Looking at benchmarks for Stable Diffusion they
by amrb 4y ago
We're in a much better place with the 7900 cards now having a hardware accelerator for FP16 and BF16 precision. Looking at benchmarks for Stable Diffusion they can match the rtx3090.
https://www.tomshardware.com/news/stable-diffusion-gpu-benchmarks https://www.tomshardware.com/news/stable-diffusion-gpu-bench...
The strategy should be to break the chicken and egg situation we are in, fixing the impression that NVIDIA is the go too.
First make the packages easy to install and get started, plus show-off things like SD performance being competitive or models on huggingface.co
Secondly if AMD can't allocate the development budget, they should open it up to the smart people in the community, give them all the hardware documentation required to build out support.
- JonChesterfield 4y ago> Secondly if AMD can't allocate the development budget, they should open it up to the smart people in the community, give them all the hardware documentation required to build out support. The Linux driver is open source and a rather comprehensive description of how the hardware is believed to work. I'd like source code for the firmware but the HSA programming model is reasonably straightforward and does appear to be implemented by the firmware. The compiler stack is LLVM and should work out of the box. As a minor existence proof, I'm one of the people responsible for having openmp on amdgpu work, and I haven't read any internal documentation whatsoever. Openmp has bugs but also has some happy users. The public ISA pdfs have been sufficient so far.
- amrb 4y agoThat's great news and thanks for the work on openmp!