3 ms·
And yet the GPU costs about as much as the whole Mac Mini and wouldn't even come close to fitting inside one.
by cpuguy83 2y ago
And yet the GPU costs about as much as the whole Mac Mini and wouldn't even come close to fitting inside one.
- angoragoats 2y agoYou're mostly correct, though a 4060Ti 16GB is 20-30% cheaper than the cheapest Mac Mini. More importantly though, "fits inside a Mac Mini" is not a criterion I'm using to evaluate whether a particular solution is suitable for LLM inference. If it is for you, that's fine, but we have vastly different priorities.