4 ms·
I'm in the same boat, about to get stuck in to Cursor. But I'm wondering if it might be better to go with a VS Code extension like Continue. With Continue you
by fallinditch 2y ago
I'm in the same boat, about to get stuck in to Cursor. But I'm wondering if it might be better to go with a VS Code extension like Continue.
With Continue you can use your own local copy of an LLM, and also query LLM API endpoints, so therefore better for a pay as you go solution and cheaper if you are a heavy user. Also you can carry on using VS Code as your editor of course.
This is my understanding of the trade offs. I assume that Cursor has better functionality and is better at coding for it to be a serious option compared with the VSCode extensions. I'm going to try out both and see what I like best.
- stormtitan 2y agoMy experience, and also what I’ve seen from a few YT videos as well, is that the local LLMs just aren’t as good as Claude and chatGPT. They don’t seem to understand or follow instructions as well as C and C.
- fallinditch 2y agoYes, good point. The latest LLMs from Anthropic, Open AI etc will always be more powerful than your local LLM. I reckon that the cutting edge cloud-based models will (continue to) provide enormous value for a range of complex actions, but that we will also derive great value from our own personal and organizational local models running on our devices and LANs. I'm assuming that small specialized LLMs for coding will become 'good enough' for a significant proportion of tasks. For example, when Codestral came out earlier this year it supposedly beat Meta’s CodeLlama 70B model in all of the top coding evaluation benchmarks, even though it's 3 x smaller.
- FloatArtifact 2y agoIt looks like it takes three different models chat/ranking/ etc. What is the total cost for three API or VRAM requirements for reasonable local open source models to run Continue?