slavik81

14 ms·

211.
by slavik81 3y ago
So, after a bit of experimentation, it seems that Fedora is built primarily for RDNA 3 while Debian is built for RDNA 2 and earlier. These are llama-cpp build instructions for Fedora: https://gist.github.com/cgmb/bb661f
212.
by slavik81 3y ago
On Fedora 40, I believe you can install llama.cpp's ROCm dependencies with: dnf install hipcc rocm-hip-devel rocblas-devel hipblas-devel
213.
Amdgpu LLVM Adding "Generic Targets" to Run on Multiple GPUs(phoronix.com)
1 points by slavik81 3y ago|0 comments
214.
Fedora 40 Cleared to Ship AMD ROCm 6(phoronix.com)
2 points by slavik81 3y ago|0 comments
215.
by slavik81 3y ago
ROCm works fine on the RDNA cards. On Ubuntu 23.10 and Debian Sid, the system packages for the ROCm math libraries have been built to run on every discrete Vega, RDNA 1, RDNA 2, CDNA 1, and CDNA 2 GPU. I've manually tested dozens of ca
216.
by slavik81 3y ago
That is intentional. We had to change the name. ROCm is no longer an acronym.
217.
by slavik81 3y ago
Imagine the electrical demand on the grid during a cold snap if everyone switched to heat pumps with resistive heating as a backup. At the time of largest demand, the largest electrical appliance in each home would be reduced to a fraction
218.
by slavik81 3y ago
https://en.wikipedia.org/wiki/CSeries_dumping_petition_by_Bo...
219.
by slavik81 3y ago
In 2010, lithium ion batteries cost $450/kWh. In 2023, lithium ion batteries cost $139/kWh. The gain in capacity has also been noticable. It's a few percent per year, but over a decade that adds up.
220.
by slavik81 3y ago
If think skilled management is expensive, just wait until you see what incompetence costs.
221.
by slavik81 3y ago
I agree it's not quite the right argument. IANAL, but I think it's more illustrative to remove AI from the example entirely. If you wrote a prompt and gave it to a human artist to draw, would you have joint copyright over the resu
222.
by slavik81 3y ago
AFAIK, the only AWS instances with AMD GPUs are g4ad with the Radeon Pro V520 (Navi 12). They don't have official support for ROCm.
223.
by slavik81 3y ago
The open-source AMDGPU KFD driver in the Linux kernel supports compute, including with the RX 580 (Polaris). It's true that AMD dropped official support for that hardware and has been closing Polaris-specific bugs as wont-fix. The last
224.
by slavik81 3y ago
This has a striking similarity to the classic, "You Wouldn't Steal a Car" PSA. https://youtu.be/HmZm8vNHBSU
225.
by slavik81 3y ago
> Our habit of trying to document bugs and limitations visibly was enormously useful to the system. As we put out each edition, the presence of these sections shamed us into fixing innumerable things rather than exhibiting them in public
226.
by slavik81 3y ago
https://www.kitchenaidparts.com/PartDetail/Gear/WPW10112253/...
227.
by slavik81 3y ago
There's a single nylon gear. The rest are made of metal. They've been using a sacrificial worm gear since the 1960s. KitchenAid switched to all-metal gears on their high-end models fairly recently. In the past, all models had a ny
228.
by slavik81 3y ago
I'm in Canada and have a 30A 240V breaker for the Debian ROCm Team's CI [1]. It's only rated for 80% continuously, so that's roughly 5.7 kW. In theory, the four systems currently hooked up to it could draw almost that mu
229.
by slavik81 3y ago
With ccache that would be a cache miss by default. However, that could be made a cache hit by configuring the CCACHE_BASEDIR option. There doesn't seem to be an exact equivalent in sccache. https://github.com/mozilla&#x
230.
by slavik81 3y ago
The sccache description was written before remote storage was added to ccache. Remote storage is a relatively new feature for ccache, and it didn't exist when sccache was created.
231.
by slavik81 3y ago
> At work I simply gave up on our 4x Radeon Pro W6800 workstation because launching Tensorflow with more than 1 GPU would cause a kernel panic every time, and AMD engineers never offered a fix other than "reinstall Ubuntu". Unf
232.
by slavik81 3y ago
The rocrand library did not have any real documentation at all until 2023. It's still pretty barebones, but the updates in article regarding the Python API seem to suggest that this is a work-in-progress.
233.
by slavik81 3y ago
There are eleven CDNA 2 systems in the top500. https://www.top500.org/lists/top500/list/2023/11/?page=1
234.
by slavik81 3y ago
I purchased two Dell Poweredge C4130 servers with 2x Intel Xeon E5-2697 v4 (18 cores @ 2.3GHz), 128 GiB of RAM @ 2400 MHz, and 2x 2000W PSUs. One with 4x AMD MI25 and one with 2x AMD FirePro S9300 X2. I rounded the cost. It was 2.5k USD for
235.
by slavik81 3y ago
> As the cherry on top, on paper one GPU family consists of different architectures! The RX 6700 XT identifies as a different 'architecture' (gfx1031) than the RX 6800 XT (gfx1030). These are 'close enough' that you c
236.
by slavik81 3y ago
In August, I bought a used server for $1k. It was manufactured in 2017 and it probably cost at least $50k when it was new. Things are expensive when they are new, but everything new will eventually become old.
237.
by slavik81 3y ago
IIRC the graphics hardware was dropped in CDNA architectures (MI100, MI200, and MI300). For example, I don't think there are texture units.
238.
by slavik81 3y ago
Unless their hardware is on the official support list, I wouldn't be too hopeful for a quick resolution. Still, it's even less likely to get fixed if it's not reported. If nothing else, I would be curious to know more about t
239.
by slavik81 3y ago
If you haven't already, please consider filing issues on the rocrand GitHub repo for the problems you encountered. The rocrand library is being actively developed and your feedback would be valuable for guiding improvements.
240.
by slavik81 3y ago
Good point. I'd been counting from when they first appeared. Your number is more accurate.

More ›