4 ms·
I would not say they are the best chips if you want to run locally. They are ok although a bit slow compared to desktop gpus for inference.
by itg 4y ago
I would not say they are the best chips if you want to run locally. They are ok although a bit slow compared to desktop gpus for inference.
- jazzyjackson 4y agoWhat desktop GPUs would you recommend for the home user with access to 20+ GB of VRAM? I can get a Mac Studio with 128GB of shared RAM for about 5k.
- lostmsu 4y agoWhat's the point of shared RAM exactly? 2x3090 ($2000) + 128GB RAM ($300) to cache weights would be much faster. Probably around 10-20x.
- dragonwriter 4y ago> What desktop GPUs would you recommend for the home user with access to 20+ GB of VRAM? I think the usual current model would be the 24GB Nvidia RTX 4090.