2 ms·
I have an M2 Pro with 32Gb RAM. I keep ollama running in the background and use it either on the terminal for a chat interface, or as a code assistant on VS Cod
by cassianoleal 3y ago
I have an M2 Pro with 32Gb RAM. I keep ollama running in the background and use it either on the terminal for a chat interface, or as a code assistant on VS Code.
It works pretty great. Of course, larger models take longer to respond or don't work at all but that hasn't been an issue for my use-case.
- minton 3y agoDo you mind sharing how you use ollama in VS Code?
- cassianoleal 3y agoHey, sure. It's nothing fancy really. I've been using 2 extensions: Continue.dev [0] and Llama Coder [1]. The former for a chat-like interface where you can ask questions about the code, request it to write a function, tests, refactor, etc. The second for an inline, more Intellisense-like completion. I'm on a Mac, so installed ollama from Homebrew, then `homebrew services enable ollama` to have it always in the background. Configuring the extensions to use it is well documented, I imagine you won't have any trouble but let me know if you get stuck. [0] https://continue.dev/ https://continue.dev/ [1] https://marketplace.visualstudio.com/items?itemName=ex3ndr.llama-coder https://marketplace.visualstudio.com/items?itemName=ex3ndr.l...