You need two 3090s or 4090s to fit 65B even in 4bit. It's a big one. That said, if you're fine with slower speeds then two P40s could get the job done for $150

You need two 3090s or 4090s to fit 65B even in 4bit. It's a big one. That said, if you're fine with slower speeds then two P40s could get the job done for $150 each. (Not sure how much slower this would go though.)