4 ms·
For large contexts, you're probably going to want CUDA. The DGX Spark is expensive but would get you decent speeds on DS4 Flash. DS4 Pro is probably not possibl
by bigyabai 6mo ago
For large contexts, you're probably going to want CUDA. The DGX Spark is expensive but would get you decent speeds on DS4 Flash. DS4 Pro is probably not possible with $10k if you want sub-10 minute prefill.