3 ms·
I also use Claude Code to install CUDA and PyTorch and HuggingFace models on my quad A100 machine. Shouldn't feel like debugging a 2000s Linux driver. HuggingF
by amirhirsch 1y ago
I also use Claude Code to install CUDA and PyTorch and HuggingFace models on my quad A100 machine. Shouldn't feel like debugging a 2000s Linux driver.
HuggingFace has incredible reach but poor UX, and PyTorch installs remain fragile. There’s real space here for a platform that makes this all seamless maybe even something that auto-updates a local SSD with fresh models to try every day.
- nicman23 1y agowhat. i mean firmware has a lot of failsafes but i would not trust it to do sysops for a 100k machine
- smokel 1y agoIt is indeed a disaster waiting to happen. Figuring out a way to run agents safely is apparently a harder problem than getting to AGI :)
- qwertytyyuu 1y agothus is the AI alignment problem
- amirhirsch 1y agoit’s all running inside a Proxmox VM with IOMMU and GPU passthrough. It’s as safe as doing the same on any cloud system. Also the machine is well north of 100K when you include the RF ADCs and DACs in there that run a radar. Worst case, I have multiple.
- nicman23 1y agoiommu does not matter ? the issue would be if one of those a100 fries.