Currently the only option for cost-efficient ML inference is Linux. MacOS doesn't have CUDA drivers, which makes it pretty much useless for production. The Pyt

Currently the only option for cost-efficient ML inference is Linux. MacOS doesn't have CUDA drivers, which makes it pretty much useless for production. The Pytorch support on M1 is nice, but there's a reason VPS providers aren't throwing away their A100s for an M1 Ultra any time soon. The inferencing performance is different by an order of magnitude on the latest chips, and still a sizable lead when adjusting for power consumption. Not sure why you'd switch to an OS with weaker driver support to try and eke out better ML performance.