3 ms·
64GB VRAM is too little to run good coding models IMHO. May be useful if you need voice models or run some slightly-smarter-regex batch processing or RAG workfl
by pornel 4mo ago
64GB VRAM is too little to run good coding models IMHO. May be useful if you need voice models or run some slightly-smarter-regex batch processing or RAG workflows. Perhaps you're supposed to buy 4 or 8 of these and split inference across them.
If you have $12K to spend, you may be better off with DGX Spark or a Mac with 128GB VRAM. That can (barely) fit DeepSeek V4 Flash.