3 ms·
We wanted to make it as easy as possible for people to try Continue, so we allow 250 free requests. These use gpt4. If you plug in your own API key in VS Code s
by sestinj 3y ago
We wanted to make it as easy as possible for people to try Continue, so we allow 250 free requests. These use gpt4. If you plug in your own API key in VS Code settings, it will also use gpt4 by default.
We'll update the /help messaging so it knows this, and you can read more about choosing a model here: https://continue.dev/docs/customization https://continue.dev/docs/customization
- FloatArtifact 3y agoLocalAI seems like a interesting project that allows self-hosted can be easily called over the network. Open AI compatible interface https://github.com/go-skynet/LocalAI https://github.com/go-skynet/LocalAI
- sestinj 3y agoThanks for sharing! We've been recommending something similar with these llama-cpp-python bindings https://github.com/abetlen/llama-cpp-python#web-server https://github.com/abetlen/llama-cpp-python#web-server, but I'll have to check that out