2 ms·
People say they think it's faster than top of the line RTX 3070[1] and hands down the fastest GPU ever for local LLM purposes, and OTOH they're like Intel integ
by numpad0 3mo ago
People say they think it's faster than top of the line RTX 3070[1] and hands down the fastest GPU ever for local LLM purposes, and OTOH they're like Intel integrated graphics with RAM shared VRAM for ultra thin laptops, so the truth is either of that, or somewhere between those two. Probably wherever its TDP suggests.
1: (Laptop)
- Havoc 3mo ago> hands down the fastest GPU ever for local LLM purposes Not really. On pure speed a 5090 will still comfortably beat a top end Mac configuration. Just constrained to 32gb mem ofc Top Mac has mem throughput around the 900 mark while a 5090 is at 1800