3 ms·
We need 128gb with a 4070 chip for about 2000 dollars. Thats what we want.
by holoduke 3y ago
We need 128gb with a 4070 chip for about 2000 dollars. Thats what we want.
- FeepingCreature 3y agoYes please.
- duffyjp 3y agoI've never tried it, but in Windows you can have CUDA apps fall back to system ram when GPU vram is exhausted. You could slap 128gb in your rig with a 4070. I'm sure performance falls off a cliff, but if it's the difference between possible and impossible that might be acceptable. https://nvidia.custhelp.com/app/answers/detail/a_id/5490/~/system-memory-fallback-for-stable-diffusion https://nvidia.custhelp.com/app/answers/detail/a_id/5490/~/s...
- ta_1138 3y agoUnfortunately production capacity for that is limited, and with sufficient demand, all pricing is an auction. Therefore, we aren't going to be seeing that card in years
- qwertox 3y agoPlease give me some DIMM slots on the GPU so that I can choose my own memory like I'm used to from the CPU-world and which I can re-use when I upgrade my GPU.
- ttul 3y agoNvidia will not build that any time soon. RAM is the dividing line between charging $40,000 vs $2500…
- int_19h 3y agoAn M1 Mac Studio with that much RAM can be had for around $3K if you look for good deals, and will give you ~8 tok/s on a 70B model, or ~5 tok/s for a 120B one.