3 ms·
The 1.3b model is amazing for real time code complete, it's fast enough to be a better intellisense. Another model you should try is magicoder 6.7b ds (based o
by eyegor 3y ago
The 1.3b model is amazing for real time code complete, it's fast enough to be a better intellisense.
Another model you should try is magicoder 6.7b ds (based on deepseek coder). After playing with it for a couple weeks, I think it gives slightly better results than the equivalent deepseek model.
Repo https://github.com/ise-uiuc/magicoder https://github.com/ise-uiuc/magicoder
Models https://huggingface.co/models?search=Magicoder-s-ds https://huggingface.co/models?search=Magicoder-s-ds
- hskalin 3y agoHow do you use these models with your editor? (E. vscode or Emacs etc)
- tarruda 3y agoAn easy way is to use an OpenAI compatible server, which means you can use any GPT plugin to integrate with your editor
- eyegor 3y agoI run tabby [0] which uses llama.cpp under the hood and they ship a vscode extension [1]. Going above 1.3b, I find the latency too distracting (but the highest end gpu I have nearby is some 16gb rtx quadro card that's a couple years old, and usually I'm running a consumer 8gb card instead). [0] https://tabby.tabbyml.com/ https://tabby.tabbyml.com/ [1] https://marketplace.visualstudio.com/items?itemName=TabbyML.vscode-tabby https://marketplace.visualstudio.com/items?itemName=TabbyML....
- tarasglek 3y agoWould you mind sharing your tabby invocation to launch this model?