3 ms·

> MacBook Pro M2 with 64GB of RAM Are there non-mac options with similar capabilities?

• simonw 2y ago
  Yes, but I don't really know anything about those. https://www.reddit.com/r/LocalLLaMA/ https://www.reddit.com/r/LocalLLaMA/ is full of people running models on PCs with NVIDIA cards. The unique benefit of an Apple Silicon Mac at the moment is that the 64GB of RAM is available to both the GPU and the CPU at once. With other hardware you usually need dedicated separate VRAM for the GPU.
• _neil 2y ago
  It’s not out yet, but the upcoming Framework desktop [0] is supposed to have a similar unified memory setup. [0] https://frame.work/desktop https://frame.work/desktop
• dwood_dev 2y ago
  Anything with the Radeon 8060S/Ryzen AI Max+ 395. One of the popular MiniPC Chinese brands has them for preorder[0] with shipping starting May 7th. Framework also has them, but shipping Q3. 0: https://www.gmktec.com/products/prepaid-deposit-amd-ryzen™-ai-max-395-evo-x2-ai-mini-pc https://www.gmktec.com/products/prepaid-deposit-amd-ryzen™-a...
  • chpatrick 2y ago
    I've never been able to get ROCm working reliably personally.
• danans 2y ago
  Nvidia Orin AGX if a desktop form factor works for you.
• chpatrick 2y ago
  I remember seeing a post about someone running the full size DeepSeek model in a dual-Xeon server with a ton of RAM.