59 ms·

Depends on your definition of budget friendly, I suppose. I was looking around the other day and the cheapest working 24GB RTX 3090 on eBay was $1800 CAD after

Depends on your definition of budget friendly, I suppose. I was looking around the other day and the cheapest working 24GB RTX 3090 on eBay was $1800 CAD after exchange rate, shipping and all the rest. Hugely inflated from the $700 they were once going for. Maybe there are still deals around.

dist-epoch 6mo ago
Because they are hugely more useful now than running some stupid game at 240 fps instead of 60 fps.
- CoolGuySteve 6mo ago
  They're not a particularly fast card compared to something like a 5070, they have lots of VRAM. That's why they were cheap before. Also "Some stupid game", who woke up and made you king of hobbies.
fluoridation 6mo ago
That's insane. I bought two in December for ARS 1.2M (a little less than USD 1000). Maybe OpenClaw raised the demand.
VladVladikoff 6mo ago
Wild I paid $1000 CAD for mine 2 years ago, I guess things have changed.
suprjami 6mo ago
Actually budget friendly is RTX 3060 12Gb. With one you can run 9B/12B models which are fine for text tasks like chatting or summarisation. Not for precision like tool calling or code. With two of them you can run models up to Qwen 27B and 35B with a few-turn context window (8k-16k). Dense at 14t/s and MoE at 68t/s. With three of them you can run 128k context, though you'll need a large format case and the right motherboard or PCIe riser. I'm running three and even with a new case this setup cost me less than one 3090.
- VladVladikoff 6mo ago
  This seems quite unlikely. What motherboard are you getting three 16x GPUs on? That alone with the associated sever processor would be more than a used 3090, before even buying the three 3060s. Give full BOM and costs.
  - suprjami 6mo ago
    I already had the PC. I just mean the extra purchase of the graphics cards. The motherboard is an MSI Pro Z690-A. The slots are physical x16. Electronically they are x16, x4, x1 which doesn't harm anything at all.

dist-epoch 6mo ago

Because they are hugely more useful now than running some stupid game at 240 fps instead of 60 fps.

CoolGuySteve 6mo ago
They're not a particularly fast card compared to something like a 5070, they have lots of VRAM. That's why they were cheap before. Also "Some stupid game", who woke up and made you king of hobbies.

fluoridation 6mo ago

That's insane. I bought two in December for ARS 1.2M (a little less than USD 1000). Maybe OpenClaw raised the demand.

VladVladikoff 6mo ago

Wild I paid $1000 CAD for mine 2 years ago, I guess things have changed.

suprjami 6mo ago

Actually budget friendly is RTX 3060 12Gb. With one you can run 9B/12B models which are fine for text tasks like chatting or summarisation. Not for precision like tool calling or code. With two of them you can run models up to Qwen 27B and 35B with a few-turn context window (8k-16k). Dense at 14t/s and MoE at 68t/s. With three of them you can run 128k context, though you'll need a large format case and the right motherboard or PCIe riser. I'm running three and even with a new case this setup cost me less than one 3090.

VladVladikoff 6mo ago
This seems quite unlikely. What motherboard are you getting three 16x GPUs on? That alone with the associated sever processor would be more than a used 3090, before even buying the three 3060s. Give full BOM and costs.
- suprjami 6mo ago
  I already had the PC. I just mean the extra purchase of the graphics cards. The motherboard is an MSI Pro Z690-A. The slots are physical x16. Electronically they are x16, x4, x1 which doesn't harm anything at all.