3 ms·

Ask HN: Llama 2 on local server. Is 3090 better than 4090?

2 points by behnamoh 3y ago

I've seen some people say that 2x3090 is better than 1x4090. The exLlama.v2 results also show a slight improvement in t/s (30 on 3090ti and 35 on 4090). If I want to be future proof, is it okay to purchase a (used) 3090 instead of 4090? Can we use 3090+4090 together later?