3 ms·
I am using the 32Gb distilled model on my local 3090 with Continue in VSCode. It beats everything out of the water.
by itissid 2y ago
I am using the 32Gb distilled model on my local 3090 with Continue in VSCode. It beats everything out of the water.
- dontwearitout 2y agoHow many tokens/s do you get on a 3090? With the extra tokens for the internal monologue, is it still performant enough for smooth VSCode integration?
- MarcelOlsz 2y agoAny idea how to use a cloud hosted version with cursor?