2 ms·
It's really sad that Cursor does not support local models yet (afaiu they fetch the URL you provide from their server). Is there a VS Code plugin or other edito
by tosh 3y ago
It's really sad that Cursor does not support local models yet (afaiu they fetch the URL you provide from their server). Is there a VS Code plugin or other editor that does?
With models like CodeGemma and Command-R+ it makes more and more sense to run them locally.
- sp332 3y agoAccording to https://forum.cursor.sh/t/support-local-llms/1099/7 https://forum.cursor.sh/t/support-local-llms/1099/7 the Cursor servers do a lot of work in between your local computer and the model. So porting all that to work on users' laptops is going to take a while.
- ericskiff 3y agoI've been playing with Continue: https://github.com/continuedev/continue https://github.com/continuedev/continue
- tosh 3y agoty for the pointer!
- tosh 3y agoAlready on ollama: https://ollama.com/library/codegemma https://ollama.com/library/codegemma
- ado__dev 3y agoCody supports local inference with Ollama for both Chat and Autocomplete. Here's how to set it up: https://sourcegraph.com/blog/local-chat-with-ollama-and-cody https://sourcegraph.com/blog/local-chat-with-ollama-and-cody :)
- tosh 3y agoty for the pointer!
- knoopx 3y agohttps://github.com/huggingface/llm-vscode https://github.com/huggingface/llm-vscode "llm.backend": "ollama", "llm.url": "http://localhost:11434/api/generate", "llm.modelId": "codegemma:2b-code-q8_0", "llm.configTemplate": "Custom", "llm.fillInTheMiddle.enabled": true, "llm.fillInTheMiddle.prefix": "<|fim_prefix|>", "llm.fillInTheMiddle.middle": "<|fim_middle|>", "llm.fillInTheMiddle.suffix": "<|fim_suffix|>", "llm.tokensToClear": ["<|fim_prefix|>", "<|fim_middle|>", "<|fim_suffix|>", "<|file_separator|>"],