4 ms·
Care to explain why? The Orin option seems massively more scalable and you can put in as beefy a machine as you want without paying the Apple tax which scales e
by ComputerGuru 3y ago
Care to explain why? The Orin option seems massively more scalable and you can put in as beefy a machine as you want without paying the Apple tax which scales exponentially with machine specs.
- jjtheblunt 3y agoexponentially is some exponentially scaled hyperbole. that said, i agree with your question!
- FlyingAvatar 3y agoNot the OP, but I would suspect the Mac Studio will retain its value better than an application specific product.
- karolist 3y agoYou will be able to resell that 192G Mac Studio for 3-4k after a few years easily, which you've bought for 6k. There's nothing competing with Apple Silicon right now for local LLMs when you look at TCO.
- wmf 3y agoI don't understand anything you're saying. Orin is not scalable at all and (IMO) overpriced given its slow CPU and GPU and it's limited to 64GB of soldered RAM while Macs can go up to 192GB. AFAIK Orin is limited to a special build of Ubuntu and has no community.
- zingelshuher 3y ago> Orin is limited to a special build of Ubuntu and has no community. Not anymore, now they allow a list of distributions. It has NVidia's first class support with all things optimized. Like CUDA, Pytorch, and so on. For now it's the best thing money can buy for mobile robot. I'm interested in Pytorch, CNNs, LLMs, video processing sort of things. Community is nice, but not sure it's possible to get reasonable performance easily from Mac Studio. Don't remember seeing Apple in the list of supported platforms for PyTorch. Nothing personal, I'm interested in the results, not the process.
- zingelshuher 3y ago> Don't remember seeing Apple in the list of supported platforms for PyTorch Correcting myself, it's there. Which makes Mac Studio an interesting option.