2 ms·
CUDA is only on nvidia GPUs, I guess a RTX Pro 6000 would get you close, two of them are 192GB in total. Vastly increased memory bandwidth too. Maybe two/four o
by embedding-shape 1y ago
CUDA is only on nvidia GPUs, I guess a RTX Pro 6000 would get you close, two of them are 192GB in total. Vastly increased memory bandwidth too. Maybe two/four of the older A100/A6000 could do the trick too.
- deeviant 1y agoRTX pro does not have NV-link, because money, however. Otherwise, people might not have to drop 40,000 for true inference GPU.