You should check these guys out. They actually do it (rack, not hosting ML models) and it seems to me to be pretty elegant: https://www.macstadium.com/blog/m4-m

You should check these guys out. They actually do it (rack, not hosting ML models) and it seems to me to be pretty elegant: https://www.macstadium.com/blog/m4-mac-mini-review https://www.macstadium.com/blog/m4-mac-mini-review