8 ms·
Hardware and cost is assumed to be approximately desktop-class. If you've got a gaming rig with an RTX 4090 and 128MB RAM, you can run this if you pick the rig
by regularfry 1y ago
Hardware and cost is assumed to be approximately desktop-class. If you've got a gaming rig with an RTX 4090 and 128MB RAM, you can run this if you pick the right quant.
- cmpxchg8b 1y ago128MB? Quantization has come a long way!
- danielhanchen 1y agoI think they mis-spoke 128GB* :)
- regularfry 1y agoWishful thinking there on my part.
- danielhanchen 1y agoThough technically < 1GB is enough - one had offload it to the SSD, albeit with very slow speeds!