2 ms·
I bought a used Dell Poweredge R620 on eBay for $150 and brought the RAM up to 128GB for another $50. It runs proxmox bare metal, with all kinds of fun contain
by distract8901 3y ago
I bought a used Dell Poweredge R620 on eBay for $150 and brought the RAM up to 128GB for another $50.
It runs proxmox bare metal, with all kinds of fun containers. I have wireshark, gitea, jellyfin, nextcloud, and a Debian VM that acts as a mirror for all of my Steam games with in-home download sharing or whatever it's called.
It doesn't have a GPU, but yesterday I started playing with llama.cpp. It has two 16 core Xeon processors, which gives me almost acceptable performance with the Wizard 13B q4 model.
Basically, any time I have the whim to play with something, I can just spin up a new container and delete it when I'm done.
This server isn't great, it's fairly old and rather inefficient. But it's definitely been an interesting experience to play around with some real enterprise hardware.
I keep it in the basement, and still you can hear it howling through the floor when llama kicks in
- abrookewood 3y agoAhh ... memories of racks of Dell servers screaming away like banshees! Still regret not taking ear plugs when working in those server rooms.
- distract8901 3y agoI've definitely learned some lessons from this machine. It was probably a mistake to buy a 1U machine. I think at some point I'll invest in a 2 or 3U machine with proper 3.5" drives and normal fans that I can replace with something quiet. But hey, for $200 total, this wasn't a bad learning experience.