3 ms·

Are m1/m2/m3 max mac's any good for this?

• downrightmike 3y ago
  Way slower than 1 gpu, at many times the cost. If you don't mind waiting minutes instead of seconds, macs are reasonable
  • fragmede 3y ago
    It depends on what you're trying to do, but I've got an M1, and doing inference with llama2-uncensored using Ollama, I get results within seconds.
    • whywhywhywhy 3y ago
      Depends what you're doing, M1 Max is around a minute for 1 SDXL image and the machine feels like it's choking while it does it while a 3090 will do it in 9 seconds and doesn't feel like it's breaking a sweat. Llama definite a bit of a different story though.
      • jeffybefffy519 3y ago
        Im more thinking about the training side because it could be compelling to buy a beefily specced m3 max if it can replace what a dedicated gpu rig could do and also be a daily driver.