3 ms·
Way slower than 1 gpu, at many times the cost. If you don't mind waiting minutes instead of seconds, macs are reasonable
by downrightmike 3y ago
Way slower than 1 gpu, at many times the cost. If you don't mind waiting minutes instead of seconds, macs are reasonable
- fragmede 3y agoIt depends on what you're trying to do, but I've got an M1, and doing inference with llama2-uncensored using Ollama, I get results within seconds.
- whywhywhywhy 3y agoDepends what you're doing, M1 Max is around a minute for 1 SDXL image and the machine feels like it's choking while it does it while a 3090 will do it in 9 seconds and doesn't feel like it's breaking a sweat. Llama definite a bit of a different story though.
- jeffybefffy519 3y agoIm more thinking about the training side because it could be compelling to buy a beefily specced m3 max if it can replace what a dedicated gpu rig could do and also be a daily driver.