> Are there any issues with just sticking one of these in a stock desktop PC and running llama.cpp? Cooling might be a challenge. The H100 has a heatsink desig

> Are there any issues with just sticking one of these in a stock desktop PC and running llama.cpp? Cooling might be a challenge. The H100 has a heatsink designed to make use of the case fans. So you need a fairly high airflow through a part which is itself passive. On a server this isn't too big a problem, you have fans in one end and GPU's blocking the exit on the other end, but in a desktop you probably need to get creative with cardboard/3d printed shrouds to force enough air through it.