3 ms·
Can you use a selfhosted LLM that fits in 12 GB VRAM as a reasonable substitute for copilot in VSCode? And if so, can you give it documentation and other code r
by sorenjan 2y ago
Can you use a selfhosted LLM that fits in 12 GB VRAM as a reasonable substitute for copilot in VSCode? And if so, can you give it documentation and other code repositories to make it better at a particular language and platform?
- 0xedd 2y agoTechnically, yes, but will yield poor results. We did it internally at big corp n+1 and it, frankly, blows. Other than menial tasks, it's good for nothing but a scout badge.
- tbrownaw 2y agoIs that really that much worse than full copilot, though? When we tried it this past spring, it was really cool but not quite useful enough to actually stick with.