5 ms·

I wish someone would make an IntelliJ/Android Studio plugin for Code Llama (or another local llm). I know both platforms have their own AI features but that inv

I wish someone would make an IntelliJ/Android Studio plugin for Code Llama (or another local llm). I know both platforms have their own AI features but that involves sending my code to their servers which I'm really not a fan of.

javajosh 3y ago
Well, you might hold your nose for a few days while Copilot helps you write the IntelliJ plugin for Code Llama. Now that would be a good hacker news post...
sestinj 3y ago
We've done work to set Continue up to be a JetBrains plugin—it's a matter of just a) figuring out the basics of putting a webview in a JetBrains plugin and b) implementing this class (https://github.com/continuedev/continue/blob/main/extension/src/continueIdeClient.ts https://github.com/continuedev/continue/blob/main/extension/...) that communicates with the server. So long story short, we're planning on this soon and welcome PRs. It's a medium-sized task.
freckletonj 3y ago
UniteAI (https://github.com/freckletonj/uniteai https://github.com/freckletonj/uniteai) I think fits the bill for you. This is my project, where the goal is to Unite your AI-stack inside your editor (so, Speech-to-text, Local LLMs, Chat GPT, Retrieval Augmented Gen, etc). It's built atop a Language Server, so, while no one has made an IntelliJ client yet, it's simple to. I'll help you do it if you make a GH Issue!
kateklink 3y ago
at Refact we have Jetbrains plugin that works with a bunch of local code models https://github.com/smallcloudai/refact/ https://github.com/smallcloudai/refact/
yangcheng 3y ago
but for code llm to be useful , the local machine need to have some very powerful GPU
- jasonjmcghee 3y ago
  not true anymore. give codellama-7b-instruct a try. Just install Ollama. Pretty mind-blowing performance for the ram it uses and how fast it is. It's in the ballpark of chatgpt-3.5-turbo for code related stuff

javajosh 3y ago

Well, you might hold your nose for a few days while Copilot helps you write the IntelliJ plugin for Code Llama. Now that would be a good hacker news post...

sestinj 3y ago

We've done work to set Continue up to be a JetBrains plugin—it's a matter of just a) figuring out the basics of putting a webview in a JetBrains plugin and b) implementing this class (https://github.com/continuedev/continue/blob/main/extension/src/continueIdeClient.ts https://github.com/continuedev/continue/blob/main/extension/...) that communicates with the server. So long story short, we're planning on this soon and welcome PRs. It's a medium-sized task.

freckletonj 3y ago

UniteAI (https://github.com/freckletonj/uniteai https://github.com/freckletonj/uniteai) I think fits the bill for you. This is my project, where the goal is to Unite your AI-stack inside your editor (so, Speech-to-text, Local LLMs, Chat GPT, Retrieval Augmented Gen, etc). It's built atop a Language Server, so, while no one has made an IntelliJ client yet, it's simple to. I'll help you do it if you make a GH Issue!

kateklink 3y ago

at Refact we have Jetbrains plugin that works with a bunch of local code models https://github.com/smallcloudai/refact/ https://github.com/smallcloudai/refact/

yangcheng 3y ago

but for code llm to be useful , the local machine need to have some very powerful GPU

jasonjmcghee 3y ago
not true anymore. give codellama-7b-instruct a try. Just install Ollama. Pretty mind-blowing performance for the ram it uses and how fast it is. It's in the ballpark of chatgpt-3.5-turbo for code related stuff