2 ms·
I would love to throw the 3060 out and replace it with a 3090... once money permits. (It's only about $800 nowadays.) But yes. I'm aware how laughably insane i
by LoganDark 3y ago
I would love to throw the 3060 out and replace it with a 3090... once money permits. (It's only about $800 nowadays.)
But yes. I'm aware how laughably insane it is to run a 70b model that way. And that's why I was pointing it out to the commenter who suggested to just run a 70b model instead.