3 ms·
Yup, that's why I bought the 3060, my first GPU card. For the 12gb. It allows me to play with LLM. I can get 7/13/30B models, but it's dog slow. It's a t
by segmondy 3y ago
Yup, that's why I bought the 3060, my first GPU card. For the 12gb. It allows me to play with LLM. I can get 7/13/30B models, but it's dog slow. It's a terrible thing that Nvidia is dragging in increasing the memory or cores just to make a profit. It's so bad, I'm thinking of selling it and buying a used P40 with 24gb which will allow for larger models at almost the same performance.