5 ms·
Host Your Own Copilot
- LarsDu88 2y agoI've been experimenting recently with replacing Github Copilot with one of the open source and open weight alternatives. This post goes over how to set these up!
- deleted 2y ago[deleted]
- arunabha 2y agoI'm confused. The article ends up using a cloud service (NVidia NIM) as the backend anyway, so is it still self hosted?
- mistrial9 2y agothe article talks about a dozen options.. the one you mention is just one of those
- LarsDu88 2y agoActually self-hosting without using the cloud at all involves building a multi-gpu rig. NIMs are just to try out the concept. Honestly, doing it this way is still a bit more secure than using OpenAI or Anthropic directly because its a slight guard against your code being used in future training sets for the next iteration of their AI.
- ramon156 2y agoAnd that's bad because? You want to use a product without improving it?
- LarsDu88 2y agoThere's two categories of folks that won't want to send their data out to "improve the product" The first is the companies that are concerned about their IP (but comfortable enough using a cloud provider). Then there's a smaller group of folks who don't want to train the next iteration of the product.
- darknavi 2y agoFYI the syntax highlighting on some of the code blocks makes it unreadable.
- LarsDu88 2y agoI've been trying to figure out how to change the color in my Hugo based static site generator, but its damn near impossible to locate the appropriate CSS
- LarsDu88 2y agoOk, I finally fixed this. Accidentally set the python code highlighting to JSON. Have changed the code highlighting theme to a lighter color.
- lostmsu 2y agoToo bad in the model comparison table they did not include the GitHub Copilot itself.
- cvjcvjcvj 2y agoCursor is better.