3 ms·
How are you patching that in? Running an LLM locally for autocomplete feels a lot more comfortable than sending code to remote servers for it. (Edit: Found the
by WaxProlix 3y ago
How are you patching that in? Running an LLM locally for autocomplete feels a lot more comfortable than sending code to remote servers for it.
(Edit: Found the docs. If you want to try this out, like I did, it's here https://continue.dev/docs/customization#run-llama-2-locally-with-ollama https://continue.dev/docs/customization#run-llama-2-locally-... )
- sestinj 3y agoWe have the user start Ollama themselves on a localhost server, and then can just add ``` models=Models( default=Ollama(model="llama2") ) ``` to the Continue config file. We'll then connect to the Ollama server, so it doesn't have to be embedded in the VS Code extension. (Edit: I see you found it! Leaving this here still)