3 ms·
> You have dense models (qwen 27b, gemma 31b) who are pretty smart, but pretty slow slowness doesn't matter a lot to me, at home. I will type up a prompt and
by naikrovek 4mo ago
> You have dense models (qwen 27b, gemma 31b) who are pretty smart, but pretty slow
slowness doesn't matter a lot to me, at home. I will type up a prompt and submit it and let it run while I do other things around the house. I have all kinds of things to do, and most of them do not require sitting in front of a computer.
of course faster would be better, but it's not always a requirement. smart and slow is far better than dumb and fast or even nothing at all.