3 ms·

Yes and no. It would work as ceph node, but I would argue that it doesn't fit the bill since you should have ~1gb mem per tb storage. If your load is low you c

Yes and no. It would work as ceph node, but I would argue that it doesn't fit the bill since you should have ~1gb mem per tb storage. If your load is low you can do with less and you could potentially use swap, but it would regularly freeze on you or crash the osd processes depending on your setup. If however you want to try it you could get raspberry pi 4s and use them over usb3. Get them with decent memory and use spinning rust to host the OS. To have an up to date version of ceph I would suggest using cephadm with podman to get it up and running with good builds. 1) enough memory 2) up to date ceph version Reminder: cephadm is kinda beta right now Maybe the odroid hc1 would be better, but I don't have one Edit: fixed auto correct

progval 6y ago
> If your load is low you can do with less and you could potentially use swap, but it would regularly freeze on you or crash the osd processes I capped my OSDs' memory usage using osd_memory_target (set to 1.5GB), to make them run on HC2s with 4TB and 6TB disks, I never had stability issues with these.
- BlackLotus89 6y ago
  Yeah I set my memory target lower as well (I think around 900mb was the smallest value setable for OSDs ... Oh it's 939524096) since this value is only a target it would generally try to hit it, but (in my case) overshoot it regularly. In normal use this isn't a problem at all, but I got OSDs restarting under heavy usage. I would be interested in your stability. Can/Did you check your logs for OSD restarts? I could imagine that OSD processes died and got restarted by systemd. If not this could just mean that you either have a lower load than me, it could be better in a newer release or my setup could have just sucked :) would be interested to hear back
  - progval 6y ago
    I get monitoring alerts when they restart, and I only remember getting two of those over two years I don't have logs anymore, since I upgraded my cluster to Nautilus which can't run on HC2s (because they are 32-bits and I can't roll back my cluster to Luminous). However I have one running on a N2 and a 6TB disk with the same memory target (1.5GB), and it didn't crash since the last reboot three weeks ago, and it's currently using 1.3GB.

progval 6y ago

> If your load is low you can do with less and you could potentially use swap, but it would regularly freeze on you or crash the osd processes I capped my OSDs' memory usage using osd_memory_target (set to 1.5GB), to make them run on HC2s with 4TB and 6TB disks, I never had stability issues with these.

BlackLotus89 6y ago
Yeah I set my memory target lower as well (I think around 900mb was the smallest value setable for OSDs ... Oh it's 939524096) since this value is only a target it would generally try to hit it, but (in my case) overshoot it regularly. In normal use this isn't a problem at all, but I got OSDs restarting under heavy usage. I would be interested in your stability. Can/Did you check your logs for OSD restarts? I could imagine that OSD processes died and got restarted by systemd. If not this could just mean that you either have a lower load than me, it could be better in a newer release or my setup could have just sucked :) would be interested to hear back
- progval 6y ago
  I get monitoring alerts when they restart, and I only remember getting two of those over two years I don't have logs anymore, since I upgraded my cluster to Nautilus which can't run on HC2s (because they are 32-bits and I can't roll back my cluster to Luminous). However I have one running on a N2 and a 6TB disk with the same memory target (1.5GB), and it didn't crash since the last reboot three weeks ago, and it's currently using 1.3GB.