This. Also, llama.cpp now works (really well) with Radeon Instinct cards, which are stupid cheap because everybody thinks you need to buy nvidia stuff. Pcie b

This. Also, llama.cpp now works (really well) with Radeon Instinct cards, which are stupid cheap because everybody thinks you need to buy nvidia stuff. Pcie bifurcation FTW!