3 ms·

I’ve got 2 rtx 4090s on an EATX motherboard. Been using them to run the full 13B un-quantized with a good deal of success. Getting about 20 tokens/s.

• int_19h 4y ago
  What is your setup for cooling? I don't think I'd want to stick another 4090-size card in mine with just air cooling...
  • valine 4y ago
    I have AIO liquid cooling for both cards. The radiators are annoying though, I might convert it to a custom loop if I ever add a third card.