3 ms·
Anyone got a line on a local first AI Tooling. Happy to pay100$. Don't want a subscription.
by cyanydeez 2y ago
Anyone got a line on a local first AI Tooling. Happy to pay100$. Don't want a subscription.
- cube2222 2y agocontinue.dev, aider, Zed’s AI assistant are all free and will work with a local Ollama installation. You will of course need an insanely beefy and expensive machine to run any useful models at reasonable speeds, which would likely cover API usage costs for many, many years (an entire lifetime, likely).
- baq 2y agoUnless you want to fine tune your custom model and/or have strict on prem requirements… shit gets expensive fast, but it’s probably worth it for some
- magic_hamster 2y agoCline also supposedly supports Ollama but it doesn't work that well with most models. There are some models dedicated to cline.
- mkw5053 2y agoYou could try OpenHands + OpenRouter + Llama (https://docs.all-hands.dev/modules/usage/llms/openrouter https://docs.all-hands.dev/modules/usage/llms/openrouter) I haven't tried it and don't know how it would go.
- tomrod 2y agoLlama.vscode and llama.vim look promising.
- 8thcross 2y agoCline or Roo Cline allows for local LLMs to be used. OpenRouter.ai - has made both Google Gemini 2.0 flash and thinking free!
- _boffin_ 2y agoCodeGPT for idea platform
- Havoc 2y agoThat’s a google away. It’ll be noticeably inferior to the hosted frontier models though