3 ms·

The 24GB of VRAM of the 3090/4090 (instead of 80GB) is a deal breaker for a lot of stuff. Also 3090 only does 2x nvlink (and 4090 has no nvlink). But a lot of

The 24GB of VRAM of the 3090/4090 (instead of 80GB) is a deal breaker for a lot of stuff. Also 3090 only does 2x nvlink (and 4090 has no nvlink). But a lot of people (including me) run 3090/4090 rigs at home, or rent them at runpod/vastai to save a buck.

blopker 3y ago
Since you seem to know and I'm having a rough time finding good info, I'd love to put together a mid range 3090 box to mess around with LLMs. Do you have any pointers to a good build list?
- redox99 3y ago
  > to mess around with LLMs You mean training or inference?